[ 526.517412] env[65855]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 526.517412] env[65855]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 527.536243] env[65943]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 527.536243] env[65943]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 529.114284] env[65943]: INFO neutron.common.config [-] Logging enabled! [ 529.114545] env[65943]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 27.0.1.dev73 [ 529.114837] env[65943]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65943) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 529.115162] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 529.115256] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 529.116073] env[65943]: WARNING oslo_policy.policy [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 529.116282] env[65943]: WARNING oslo_policy.policy [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 529.118270] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] VMware NSXv3 Agent initialized successfully. [ 529.118270] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] Acquiring lock "singleton_lock" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 529.118383] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] Acquired lock "singleton_lock" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 529.118539] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] Releasing lock "singleton_lock" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 529.118819] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] Full set of CONF: {{(pid=65943) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 529.118963] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] ******************************************************************************** {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 529.119224] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] Configuration options gathered from: {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 529.119377] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 529.121494] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 529.121494] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] ================================================================================ {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 529.121494] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] agent_down_time = 75 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.121494] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] allow_automatic_dhcp_failover = True {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.121494] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] allow_bulk = True {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.121494] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] api_extensions_path = {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.121694] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] api_paste_config = api-paste.ini {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.121694] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] auth_strategy = keystone {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.121694] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] backdoor_port = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.121694] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] backdoor_socket = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.121694] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] backlog = 4096 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.121694] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] base_mac = fa:16:3e:00:00:00 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.121694] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] bind_host = 0.0.0.0 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.121900] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] bind_port = 9696 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.121900] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] client_socket_timeout = 900 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.121900] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] config_dir = [] {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.121900] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.121900] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] config_source = [] {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.121900] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] control_exchange = neutron {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.122133] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] core_plugin = ml2 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.122161] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] debug = True {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.122340] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] default_availability_zones = [] {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.122463] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.122826] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] dhcp_agent_notification = True {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.122826] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] dhcp_agents_per_network = 1 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.122826] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] dhcp_lease_duration = 86400 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.123017] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] dhcp_load_type = networks {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.123108] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] dns_domain = openstacklocal {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.123241] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.123365] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] enable_default_route_bfd = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.123488] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] enable_default_route_ecmp = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.123668] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] enable_dvr = True {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.123901] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] enable_new_agents = True {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.123961] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.124098] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] enable_signals = True {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.124224] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] enable_traditional_dhcp = True {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.124344] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] external_dns_driver = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.124466] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] filter_validation = True {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.124600] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] global_physnet_mtu = 8950 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.124724] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] graceful_shutdown_timeout = 60 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.124915] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] host = cpu-1 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.125068] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] host_dvr_for_dhcp = True {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.125201] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] http_retries = 3 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.125354] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] instance_format = [instance: %(uuid)s] {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.125458] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.125590] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] ipam_driver = internal {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.125715] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] ipv6_pd_enabled = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.125839] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] l3_ha = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.125969] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.126112] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] l3_ha_network_physical_name = {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.126244] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] l3_ha_network_type = {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.126377] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] log_color = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.126507] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] log_config_append = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.126641] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.126768] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] log_dir = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.126930] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] log_file = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.127047] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] log_options = True {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.127185] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] log_rotate_interval = 1 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.127322] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] log_rotate_interval_type = days {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.127455] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] log_rotation_type = none {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.127557] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.127654] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.127791] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.127923] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.128032] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.128165] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] max_dns_nameservers = 5 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.128291] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] max_header_line = 16384 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.128417] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] max_l3_agents_per_router = 3 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.128538] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] max_logfile_count = 30 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.128658] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] max_logfile_size_mb = 200 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.128781] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] max_subnet_host_routes = 20 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.128916] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] my_ip = 10.180.1.21 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.129058] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] my_ipv6 = ::1 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.129189] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] network_auto_schedule = True {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.129313] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] network_link_prefix = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.129447] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.129583] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] notify_nova_on_port_data_changes = True {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.129717] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] notify_nova_on_port_status_changes = True {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.129849] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] pagination_max_limit = -1 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.129976] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] publish_errors = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.130113] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] rate_limit_burst = 0 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.130252] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] rate_limit_except_level = CRITICAL {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.130375] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] rate_limit_interval = 0 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.130501] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] retry_until_window = 30 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.130631] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] router_distributed = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.130757] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] rpc_resources_processing_step = 20 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.130882] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] rpc_response_max_timeout = 600 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.131015] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] rpc_response_timeout = 60 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.131142] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] send_events_interval = 2 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.131287] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] service_plugins = ['router'] {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.131423] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] setproctitle = on {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.131548] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] shell_completion = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.131678] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] state_path = /opt/stack/data/neutron {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.131809] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] syslog_log_facility = LOG_USER {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.131940] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] tcp_keepidle = 600 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.132087] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] transport_url = **** {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.132219] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] use_journal = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.132344] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] use_json = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.132468] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] use_ssl = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.132593] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] use_stderr = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.132724] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] use_syslog = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.132847] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] vlan_qinq = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.132971] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] vlan_transparent = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.133108] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] watch_log_file = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.133240] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] wsgi_default_pool_size = 100 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.133364] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] wsgi_keep_alive = True {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.133498] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.133624] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] wsgi_server_debug = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.133801] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_concurrency.disable_process_locking = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.133938] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.134093] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.134224] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.134389] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.134512] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.134661] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.134828] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] profiler.connection_string = messaging:// {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.134977] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] profiler.enabled = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.135128] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] profiler.es_doc_type = notification {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.135265] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] profiler.es_scroll_size = 10000 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.135398] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] profiler.es_scroll_time = 2m {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.135528] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] profiler.filter_error_trace = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.135662] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] profiler.hmac_keys = **** {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.135797] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] profiler.sentinel_service_name = mymaster {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.135939] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] profiler.socket_timeout = 0.1 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.136077] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] profiler.trace_requests = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.136206] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] profiler.trace_sqlalchemy = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.136344] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] profiler_jaeger.process_tags = {} {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.136471] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] profiler_jaeger.service_name_prefix = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.136603] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] profiler_otlp.service_name_prefix = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.136746] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_policy.enforce_new_defaults = True {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.137034] env[65943]: WARNING oslo_config.cfg [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 529.137173] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_policy.enforce_scope = True {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.137313] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_policy.policy_default_rule = default {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.137457] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.137592] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.137727] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.137854] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.137981] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.138439] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.138439] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.138439] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_policy.remote_timeout = 60.0 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.138527] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.138639] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] agent.extensions = [] {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.138770] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.138925] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] service_providers.service_provider = [] {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.139082] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] QUOTAS.default_quota = -1 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.139222] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.139360] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] QUOTAS.quota_floatingip = 50 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.139480] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] QUOTAS.quota_network = 100 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.139605] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] QUOTAS.quota_port = 500 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.139732] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.139859] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] QUOTAS.quota_router = 10 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.139988] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] QUOTAS.quota_security_group = 10 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.140124] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.140251] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] QUOTAS.quota_subnet = 100 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.140376] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] QUOTAS.track_quota_usage = True {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.140518] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.140643] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep.group = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.140767] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep.helper_command = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.140895] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep.log_daemon_traceback = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.141030] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.141161] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep.thread_pool_size = 8 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.141284] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep.user = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.141415] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.141539] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep_dhcp_release.group = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.141662] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep_dhcp_release.helper_command = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.141791] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.141917] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.142051] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.142179] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep_dhcp_release.user = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.142313] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.142435] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep_ovs_vsctl.group = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.142558] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep_ovs_vsctl.helper_command = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.142684] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.142812] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.142940] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.143074] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep_ovs_vsctl.user = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.143208] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep_namespace.capabilities = [21] {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.143332] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep_namespace.group = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.143454] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep_namespace.helper_command = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.143581] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep_namespace.log_daemon_traceback = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.143713] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.143868] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep_namespace.thread_pool_size = 8 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.144014] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep_namespace.user = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.144156] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep_conntrack.capabilities = [12] {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.144304] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep_conntrack.group = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.144409] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep_conntrack.helper_command = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.144538] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.144670] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.144822] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.144959] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep_conntrack.user = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.145107] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep_link.capabilities = [12, 21] {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.145234] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep_link.group = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.145359] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep_link.helper_command = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.145491] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep_link.log_daemon_traceback = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.145624] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.145753] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep_link.thread_pool_size = 8 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.145874] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] privsep_link.user = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.146037] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.146207] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.146351] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] AGENT.continue_on_failed_promotions = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.146481] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] AGENT.dscp = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.146614] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] AGENT.dscp_inherit = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.146751] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] AGENT.force_mp_to_policy = True {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.146879] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] AGENT.locking_coordinator_url = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.147017] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] AGENT.log_agent_heartbeats = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.147155] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] AGENT.logging_expire = 1 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.147294] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.147424] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.147559] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] AGENT.polling_interval = 240 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.147688] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.147826] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.147962] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] AGENT.report_interval = 30.0 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.148114] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.148252] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.148388] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.148522] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] AGENT.sync_skew = 60 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.148652] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] AGENT.synchronization_queue_size = 20 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.148783] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] AGENT.use_helper_for_ns_read = True {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.148923] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] SECURITYGROUP.enable_ipset = True {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.149073] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] SECURITYGROUP.enable_security_group = True {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.149211] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.149350] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.149491] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] experimental.ipv6_pd_enabled = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.149641] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] ml2.extension_drivers = ['port_security'] {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.149771] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] ml2.external_network_type = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.149913] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.150060] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] ml2.overlay_ip_version = 4 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.150196] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] ml2.path_mtu = 8950 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.150329] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] ml2.physical_network_mtus = {} {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.150467] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] ml2.tenant_network_types = ['vlan'] {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.150601] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.150738] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] ml2.type_drivers = ['vlan'] {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.150884] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] AGENT_CLI.neutron_port_id = [] {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.151058] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.151182] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.151331] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.151470] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.151603] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.151740] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.151870] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.152014] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.152209] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.152350] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] NSXV3.nsxv3_login_password = **** {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.152490] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] NSXV3.nsxv3_login_port = 443 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.152622] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] NSXV3.nsxv3_login_user = admin {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.152755] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.152896] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.153066] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.153167] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.153303] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.153440] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.153574] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.153709] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.153868] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.154015] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.154157] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.154289] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.154421] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.154604] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.154826] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] vsphere.vsphere_login_password = VMware1! {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.154990] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.155141] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.155278] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] nova.auth_section = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.155420] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] nova.auth_type = password {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.155557] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.155685] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] nova.certfile = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.155817] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] nova.collect_timing = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.155954] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] nova.endpoint_type = public {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.156093] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] nova.insecure = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.156218] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] nova.keyfile = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.156351] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] nova.region_name = RegionOne {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.156480] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] nova.split_loggers = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.156603] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] nova.timeout = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.156733] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] placement.auth_section = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.156868] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] placement.auth_type = password {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.157009] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.157137] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] placement.certfile = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.157265] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] placement.collect_timing = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.157395] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] placement.endpoint_type = public {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.157522] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] placement.insecure = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.157643] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] placement.keyfile = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.157765] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] placement.region_name = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.157890] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] placement.split_loggers = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.158022] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] placement.timeout = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.158156] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] ironic.auth_section = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.158288] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] ironic.auth_type = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.158413] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] ironic.cafile = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.158535] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] ironic.certfile = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.158661] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] ironic.collect_timing = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.158785] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] ironic.connect_retries = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.158910] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] ironic.connect_retry_delay = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.159055] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] ironic.enable_notifications = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.159182] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] ironic.endpoint_override = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.159308] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] ironic.insecure = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.159431] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] ironic.interface = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.159553] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] ironic.keyfile = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.159680] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] ironic.max_version = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.159801] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] ironic.min_version = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.159928] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] ironic.region_name = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.160058] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] ironic.retriable_status_codes = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.160182] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] ironic.service_name = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.160305] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] ironic.service_type = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.160431] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] ironic.split_loggers = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.160552] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] ironic.status_code_retries = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.160672] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] ironic.status_code_retry_delay = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.160793] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] ironic.timeout = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.160916] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] ironic.valid_interfaces = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.161082] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] ironic.version = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.161601] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] cli_script.dry_run = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.161601] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.161601] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.161689] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.161773] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.161896] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.162031] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.162160] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.162291] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.162418] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.162555] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.162680] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.162815] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.162955] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.163107] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.163238] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.163375] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.163504] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.163635] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.163804] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.163928] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.164072] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.164204] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.164330] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.164459] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.164587] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.164714] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.164899] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.165075] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.165211] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.165340] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.165469] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_rabbit.ssl = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.165605] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.165779] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.165864] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.165999] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.166169] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_rabbit.ssl_version = {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.166313] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.166455] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_notifications.driver = [] {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.166585] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_notifications.retry = -1 {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.166730] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.166861] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] oslo_messaging_notifications.transport_url = **** {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.166957] env[65943]: DEBUG oslo_service.backend._eventlet.service [None req-5f8ae9d7-c962-4ccb-8934-4e57ac4ca063 None None] ******************************************************************************** {{(pid=65943) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 529.168094] env[65943]: DEBUG neutron.agent.securitygroups_rpc [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Init firewall settings (driver=nsxv3) {{(pid=65943) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 529.169424] env[65943]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65943) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 529.169663] env[65943]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] RPC agent_id: nsxm-l-01a.corp.local [ 529.171861] env[65943]: DEBUG dogpile.cache.region [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 529.171976] env[65943]: DEBUG dogpile.lock [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 529.172083] env[65943]: DEBUG dogpile.lock [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 529.172170] env[65943]: DEBUG dogpile.lock [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 529.172258] env[65943]: DEBUG dogpile.cache.region [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 529.172341] env[65943]: DEBUG dogpile.lock [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 529.172459] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 529.209316] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Session token - acquiring [ 529.210899] env[65943]: DEBUG networking_nsxv3.common.locking [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 529.211121] env[65943]: DEBUG oslo_concurrency.lockutils [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 529.211184] env[65943]: DEBUG oslo_concurrency.lockutils [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 529.211625] env[65943]: DEBUG oslo_concurrency.lockutils [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 529.224268] env[65943]: DEBUG oslo_concurrency.lockutils [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 529.515126] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 529.538330] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 529.538596] env[65943]: DEBUG dogpile.cache.region [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Cache value generated in 0.366 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 529.538596] env[65943]: DEBUG dogpile.lock [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 529.538743] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Activating Policy API Provider. [ 529.538943] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Looking for the default Infrastructure Rules. [ 529.609220] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Looking for the Default Layer3 Logged Drop Section. [ 529.628515] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 529.628994] env[65943]: DEBUG networking_nsxv3.common.locking [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 529.629184] env[65943]: DEBUG oslo_concurrency.lockutils [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Acquiring lock "all" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 529.629287] env[65943]: DEBUG oslo_concurrency.lockutils [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Acquired lock "all" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 529.629582] env[65943]: DEBUG oslo_concurrency.lockutils [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Acquired external semaphore "all" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 529.629914] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 530.143932] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 530.646248] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 531.148728] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Inventory metadata is going to be refreshed. [ 531.149267] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 532.161398] env[65943]: DEBUG networking_nsxv3.common.locking [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.161933] env[65943]: DEBUG oslo_concurrency.lockutils [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.161933] env[65943]: DEBUG oslo_concurrency.lockutils [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.162286] env[65943]: DEBUG oslo_concurrency.lockutils [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.174788] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 532.175749] env[65943]: DEBUG oslo_concurrency.lockutils [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.176598] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 532.197709] env[65943]: DEBUG networking_nsxv3.common.locking [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.197946] env[65943]: DEBUG oslo_concurrency.lockutils [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.198126] env[65943]: DEBUG oslo_concurrency.lockutils [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.198405] env[65943]: DEBUG oslo_concurrency.lockutils [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.198500] env[65943]: DEBUG oslo_concurrency.lockutils [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.198628] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 532.198740] env[65943]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65943) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 532.198839] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 532.229228] env[65943]: DEBUG networking_nsxv3.common.locking [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.229228] env[65943]: DEBUG oslo_concurrency.lockutils [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.229228] env[65943]: DEBUG oslo_concurrency.lockutils [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.229228] env[65943]: DEBUG oslo_concurrency.lockutils [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.229228] env[65943]: DEBUG oslo_concurrency.lockutils [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.229228] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 532.249508] env[65943]: DEBUG networking_nsxv3.common.locking [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.249508] env[65943]: DEBUG oslo_concurrency.lockutils [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.249508] env[65943]: DEBUG oslo_concurrency.lockutils [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.249508] env[65943]: DEBUG oslo_concurrency.lockutils [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.249508] env[65943]: DEBUG oslo_concurrency.lockutils [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.249508] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 532.272106] env[65943]: DEBUG networking_nsxv3.common.locking [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.272453] env[65943]: DEBUG oslo_concurrency.lockutils [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Acquiring lock "Address Group" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.272453] env[65943]: DEBUG oslo_concurrency.lockutils [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Acquired lock "Address Group" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.272695] env[65943]: DEBUG oslo_concurrency.lockutils [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Acquired external semaphore "Address Group" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.272844] env[65943]: DEBUG oslo_concurrency.lockutils [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Releasing lock "Address Group" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.273012] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 532.273119] env[65943]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65943) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 532.273218] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 532.297342] env[65943]: DEBUG networking_nsxv3.common.locking [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.297723] env[65943]: DEBUG oslo_concurrency.lockutils [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Acquiring lock "Segment QoS" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.297833] env[65943]: DEBUG oslo_concurrency.lockutils [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Acquired lock "Segment QoS" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.298177] env[65943]: DEBUG oslo_concurrency.lockutils [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Acquired external semaphore "Segment QoS" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.298324] env[65943]: DEBUG oslo_concurrency.lockutils [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Releasing lock "Segment QoS" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.298478] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 532.298586] env[65943]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65943) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 532.298689] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 532.324303] env[65943]: DEBUG networking_nsxv3.common.locking [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.324750] env[65943]: DEBUG oslo_concurrency.lockutils [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.324750] env[65943]: DEBUG oslo_concurrency.lockutils [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.324909] env[65943]: DEBUG oslo_concurrency.lockutils [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.325063] env[65943]: DEBUG oslo_concurrency.lockutils [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.325230] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 532.325334] env[65943]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65943) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 532.325433] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Inventory metadata have been refreshed. [ 532.325550] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Dryrun:True. Metadata refresh completed. [ 532.325739] env[65943]: DEBUG oslo_concurrency.lockutils [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Releasing lock "all" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.327540] env[65943]: INFO neutron.agent.agent_extensions_manager [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Loaded agent extensions: [] [ 532.328347] env[65943]: DEBUG neutron_lib.callbacks.manager [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65943) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 532.383084] env[65943]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] NSXv3 Agent Agent RPC Daemon Started! [ 532.383347] env[65943]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] NSXv3 Agent Agent loop - iteration:0 started [ 532.383347] env[65943]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] NSXv3 Agent Agent out of sync with plugin! [ 537.330025] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 537.330025] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 542.330525] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 542.330927] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 547.139672] env[65943]: INFO networking_nsxv3.common.synchronization [None req-2a08fec4-1ce3-43d3-8152-1e3d5a2532a0 demo admin] Enqueued Resource ID: 58d564ef-46d5-4864-a871-9d3fe5485c86 with Priority: HIGHEST for action security_group_rules [ 547.140211] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d564ef-46d5-4864-a871-9d3fe5485c86 with Priority: HIGHEST for action security_group_rules [ 547.140505] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58d564ef-46d5-4864-a871-9d3fe5485c86 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.140629] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58d564ef-46d5-4864-a871-9d3fe5485c86" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.140694] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58d564ef-46d5-4864-a871-9d3fe5485c86" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.141035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58d564ef-46d5-4864-a871-9d3fe5485c86" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.141121] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58d564ef-46d5-4864-a871-9d3fe5485c86',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 547.660529] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.660792] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.660792] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.660943] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.661034] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.661134] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58d564ef-46d5-4864-a871-9d3fe5485c86 already deleted. [ 547.661218] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58d564ef-46d5-4864-a871-9d3fe5485c86" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 552.141626] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 552.142036] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 557.143083] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 557.143733] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 562.144588] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 562.144995] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 567.145972] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 567.145972] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 570.332685] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.332685] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.332685] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.332685] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.332685] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.834436] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 571.338479] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 571.840022] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 571.840151] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 572.147037] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 572.148741] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 572.598521] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.598884] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.598884] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.599016] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.610322] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 572.611295] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.612329] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 572.632078] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.632233] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.632300] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.632513] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.632603] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.632714] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 572.632785] env[65943]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65943) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 572.632856] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 572.652984] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.653162] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.653216] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.653436] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.653530] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.653642] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 572.674598] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.674758] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.675093] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.675093] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.675161] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.675245] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 572.696283] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.696453] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.696508] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.696683] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.696800] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.696895] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 572.696962] env[65943]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65943) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 572.697040] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 572.715044] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.715259] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.715259] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.715610] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.715721] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.715839] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 572.715915] env[65943]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65943) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 572.715988] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 572.737201] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.737338] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.737338] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.737507] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.737630] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.737747] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 572.737818] env[65943]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65943) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 572.737887] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 572.737951] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 572.738035] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 572.738096] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 572.738156] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 572.738439] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 572.738505] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 572.738573] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 572.758076] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.758234] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.758299] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.758502] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.758607] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.758715] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 572.778892] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.779137] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.779137] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.779295] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.779392] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.820706] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.004686] env[65943]: INFO networking_nsxv3.common.synchronization [None req-1cf81cca-bb6e-44c9-ae0b-c214be98a8a9 None None] Enqueued Resource ID: 956444c4-5aee-4642-ace6-28afe3364a5b with Priority: HIGHEST for action port [ 576.004686] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 956444c4-5aee-4642-ace6-28afe3364a5b with Priority: HIGHEST for action port [ 576.004686] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-956444c4-5aee-4642-ace6-28afe3364a5b taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.004686] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-956444c4-5aee-4642-ace6-28afe3364a5b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.004686] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-956444c4-5aee-4642-ace6-28afe3364a5b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.004686] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-956444c4-5aee-4642-ace6-28afe3364a5b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.004686] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('956444c4-5aee-4642-ace6-28afe3364a5b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.507094] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 956444c4-5aee-4642-ace6-28afe3364a5b [ 576.507333] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.507467] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.507538] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.507753] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.507843] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.507932] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:956444c4-5aee-4642-ace6-28afe3364a5b already deleted. [ 576.508018] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-956444c4-5aee-4642-ace6-28afe3364a5b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.281164] env[65943]: INFO networking_nsxv3.common.synchronization [None req-3897f837-cbfc-442a-a966-4fdf62f4e278 None None] Enqueued Resource ID: 0a1181c4-654b-43ef-adf8-dd732a605fc4 with Priority: HIGHEST for action port [ 578.281164] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a1181c4-654b-43ef-adf8-dd732a605fc4 with Priority: HIGHEST for action port [ 578.281749] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a1181c4-654b-43ef-adf8-dd732a605fc4 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.281749] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a1181c4-654b-43ef-adf8-dd732a605fc4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.281749] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a1181c4-654b-43ef-adf8-dd732a605fc4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.281986] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a1181c4-654b-43ef-adf8-dd732a605fc4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.282094] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a1181c4-654b-43ef-adf8-dd732a605fc4',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.787777] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0a1181c4-654b-43ef-adf8-dd732a605fc4 [ 578.788015] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.788174] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.788306] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.788548] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.788621] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.788714] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0a1181c4-654b-43ef-adf8-dd732a605fc4 already deleted. [ 578.788812] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a1181c4-654b-43ef-adf8-dd732a605fc4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.070166] env[65943]: INFO networking_nsxv3.common.synchronization [None req-c1831419-fa59-4341-b258-d7c56e484bae None None] Enqueued Resource ID: 7b5cb56a-baa8-4d21-9f89-a9e1641ca658 with Priority: HIGHEST for action port [ 579.071709] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b5cb56a-baa8-4d21-9f89-a9e1641ca658 with Priority: HIGHEST for action port [ 579.071709] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b5cb56a-baa8-4d21-9f89-a9e1641ca658 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.071709] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b5cb56a-baa8-4d21-9f89-a9e1641ca658" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.071709] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b5cb56a-baa8-4d21-9f89-a9e1641ca658" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.071709] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b5cb56a-baa8-4d21-9f89-a9e1641ca658" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.071935] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b5cb56a-baa8-4d21-9f89-a9e1641ca658',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.518530] env[65943]: INFO networking_nsxv3.common.synchronization [None req-2143ad1c-d35d-42f0-92e5-07efcae386c4 None None] Enqueued Resource ID: 4906b086-39d5-4e57-817b-13f4eb041364 with Priority: HIGHEST for action port [ 579.519063] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4906b086-39d5-4e57-817b-13f4eb041364 with Priority: HIGHEST for action port [ 579.519356] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-4906b086-39d5-4e57-817b-13f4eb041364 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.519477] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4906b086-39d5-4e57-817b-13f4eb041364" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.519567] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4906b086-39d5-4e57-817b-13f4eb041364" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.520269] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4906b086-39d5-4e57-817b-13f4eb041364" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.520269] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4906b086-39d5-4e57-817b-13f4eb041364',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.577167] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7b5cb56a-baa8-4d21-9f89-a9e1641ca658 [ 579.577899] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.577899] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.577899] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.578075] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.578075] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.578190] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7b5cb56a-baa8-4d21-9f89-a9e1641ca658 already deleted. [ 579.578255] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b5cb56a-baa8-4d21-9f89-a9e1641ca658" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.022872] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4906b086-39d5-4e57-817b-13f4eb041364 [ 580.023115] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.023246] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.023314] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.023515] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.024202] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.024202] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4906b086-39d5-4e57-817b-13f4eb041364 already deleted. [ 580.024202] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4906b086-39d5-4e57-817b-13f4eb041364" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.486498] env[65943]: INFO networking_nsxv3.common.synchronization [None req-7fb55191-4097-4851-adab-3add1bccac04 None None] Enqueued Resource ID: cb81fe24-48e8-456a-b398-a147a9c2b2d5 with Priority: HIGHEST for action port [ 580.486498] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb81fe24-48e8-456a-b398-a147a9c2b2d5 with Priority: HIGHEST for action port [ 580.486498] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb81fe24-48e8-456a-b398-a147a9c2b2d5 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.486498] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb81fe24-48e8-456a-b398-a147a9c2b2d5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.486498] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb81fe24-48e8-456a-b398-a147a9c2b2d5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.486498] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb81fe24-48e8-456a-b398-a147a9c2b2d5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.486498] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb81fe24-48e8-456a-b398-a147a9c2b2d5',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.852065] env[65943]: INFO networking_nsxv3.common.synchronization [None req-ef22da09-9a65-4d97-a77a-f6a9240ea3ff None None] Enqueued Resource ID: 177594db-a6ae-4937-a931-c757350d46ae with Priority: HIGHEST for action port [ 580.852348] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 177594db-a6ae-4937-a931-c757350d46ae with Priority: HIGHEST for action port [ 580.852913] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-177594db-a6ae-4937-a931-c757350d46ae taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.854022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-177594db-a6ae-4937-a931-c757350d46ae" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.854022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-177594db-a6ae-4937-a931-c757350d46ae" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.854022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-177594db-a6ae-4937-a931-c757350d46ae" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.854022] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('177594db-a6ae-4937-a931-c757350d46ae',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.993032] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cb81fe24-48e8-456a-b398-a147a9c2b2d5 [ 580.993032] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.993032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.993032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.993032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.993032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.993032] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cb81fe24-48e8-456a-b398-a147a9c2b2d5 already deleted. [ 580.993032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb81fe24-48e8-456a-b398-a147a9c2b2d5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.356771] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 177594db-a6ae-4937-a931-c757350d46ae [ 581.356771] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.356771] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.356771] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.356771] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.356771] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.356771] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:177594db-a6ae-4937-a931-c757350d46ae already deleted. [ 581.356771] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-177594db-a6ae-4937-a931-c757350d46ae" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.845867] env[65943]: INFO networking_nsxv3.common.synchronization [None req-f8467de4-25a6-43bd-b169-67820f545d17 None None] Enqueued Resource ID: 343cbe55-c883-4169-94ab-d088533c999c with Priority: HIGHEST for action port [ 581.846464] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 343cbe55-c883-4169-94ab-d088533c999c with Priority: HIGHEST for action port [ 581.847066] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-343cbe55-c883-4169-94ab-d088533c999c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.847246] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-343cbe55-c883-4169-94ab-d088533c999c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.847282] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-343cbe55-c883-4169-94ab-d088533c999c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.847494] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-343cbe55-c883-4169-94ab-d088533c999c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.847569] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('343cbe55-c883-4169-94ab-d088533c999c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.182729] env[65943]: INFO networking_nsxv3.common.synchronization [None req-24931816-634c-400c-9238-627cde42dbc9 None None] Enqueued Resource ID: ab252c1a-5d90-40b1-870a-2ec0f1ff07f3 with Priority: HIGHEST for action port [ 582.183541] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab252c1a-5d90-40b1-870a-2ec0f1ff07f3 with Priority: HIGHEST for action port [ 582.184335] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab252c1a-5d90-40b1-870a-2ec0f1ff07f3 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.184335] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab252c1a-5d90-40b1-870a-2ec0f1ff07f3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.184335] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab252c1a-5d90-40b1-870a-2ec0f1ff07f3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.184335] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab252c1a-5d90-40b1-870a-2ec0f1ff07f3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.184335] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab252c1a-5d90-40b1-870a-2ec0f1ff07f3',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.350941] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 343cbe55-c883-4169-94ab-d088533c999c [ 582.351270] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.351408] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.351478] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.351693] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.351770] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.351990] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:343cbe55-c883-4169-94ab-d088533c999c already deleted. [ 582.351990] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-343cbe55-c883-4169-94ab-d088533c999c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.688463] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ab252c1a-5d90-40b1-870a-2ec0f1ff07f3 [ 582.688463] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.688463] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.688463] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.688463] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.688463] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.688463] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ab252c1a-5d90-40b1-870a-2ec0f1ff07f3 already deleted. [ 582.688463] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab252c1a-5d90-40b1-870a-2ec0f1ff07f3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.764079] env[65943]: INFO networking_nsxv3.common.synchronization [None req-bfaccf05-10e8-4d5e-adfa-5a5619180435 None None] Enqueued Resource ID: 4d9ab7f3-2b3b-4247-883e-50d637c82846 with Priority: HIGHEST for action port [ 582.764079] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d9ab7f3-2b3b-4247-883e-50d637c82846 with Priority: HIGHEST for action port [ 582.764079] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d9ab7f3-2b3b-4247-883e-50d637c82846 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.764079] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d9ab7f3-2b3b-4247-883e-50d637c82846" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.764079] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d9ab7f3-2b3b-4247-883e-50d637c82846" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.764079] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d9ab7f3-2b3b-4247-883e-50d637c82846" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.764079] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d9ab7f3-2b3b-4247-883e-50d637c82846',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.267234] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4d9ab7f3-2b3b-4247-883e-50d637c82846 [ 583.267518] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.267584] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.267715] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.268016] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.268163] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.268284] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4d9ab7f3-2b3b-4247-883e-50d637c82846 already deleted. [ 583.268369] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d9ab7f3-2b3b-4247-883e-50d637c82846" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.898841] env[65943]: INFO networking_nsxv3.common.synchronization [req-58dacb16-2a17-4336-a7be-46dd0b7fd68d req-47f67bb7-b900-4875-9993-3d6d1ad4d7ce tempest-DeleteServersAdminTestJSON-941821739 tempest-DeleteServersAdminTestJSON-941821739-project-member] Enqueued Resource ID: e550f237-9e27-45ea-9e02-516ac8d2852f with Priority: HIGHEST for action security_group_members [ 583.899305] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e550f237-9e27-45ea-9e02-516ac8d2852f with Priority: HIGHEST for action security_group_members [ 583.900370] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e550f237-9e27-45ea-9e02-516ac8d2852f taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.900474] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.900474] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.900710] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.900858] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.900955] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.901100] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.901257] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.901345] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.904306] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e550f237-9e27-45ea-9e02-516ac8d2852f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.407182] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.407983] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.408084] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.412023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.412023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.412023] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.412023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.412023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.412023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.412023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.412023] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e550f237-9e27-45ea-9e02-516ac8d2852f already deleted. [ 584.412023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.412023] env[65943]: INFO networking_nsxv3.common.synchronization [None req-d12721a3-4d94-4099-aebd-a6eeb284a76d None None] Enqueued Resource ID: 374ba89e-c79c-4c86-9ad0-efef4e9bc2be with Priority: HIGHEST for action port [ 584.412023] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 374ba89e-c79c-4c86-9ad0-efef4e9bc2be with Priority: HIGHEST for action port [ 584.412723] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-374ba89e-c79c-4c86-9ad0-efef4e9bc2be taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.412851] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-374ba89e-c79c-4c86-9ad0-efef4e9bc2be" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.412919] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-374ba89e-c79c-4c86-9ad0-efef4e9bc2be" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.413157] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-374ba89e-c79c-4c86-9ad0-efef4e9bc2be" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.413239] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('374ba89e-c79c-4c86-9ad0-efef4e9bc2be',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.528618] env[65943]: INFO networking_nsxv3.common.synchronization [None req-3bac97f1-f722-4f50-a3f8-ccbbefacd5eb None None] Enqueued Resource ID: acc778e0-c04c-430f-89f9-274d6002de58 with Priority: HIGHEST for action port [ 584.529163] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acc778e0-c04c-430f-89f9-274d6002de58 with Priority: HIGHEST for action port [ 584.529458] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-acc778e0-c04c-430f-89f9-274d6002de58 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.529681] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-acc778e0-c04c-430f-89f9-274d6002de58" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.529681] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-acc778e0-c04c-430f-89f9-274d6002de58" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.529878] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-acc778e0-c04c-430f-89f9-274d6002de58" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.529982] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acc778e0-c04c-430f-89f9-274d6002de58',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.916094] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 374ba89e-c79c-4c86-9ad0-efef4e9bc2be [ 584.916407] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.916511] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.916511] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.916731] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.916826] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.916922] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:374ba89e-c79c-4c86-9ad0-efef4e9bc2be already deleted. [ 584.917009] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-374ba89e-c79c-4c86-9ad0-efef4e9bc2be" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.032818] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port acc778e0-c04c-430f-89f9-274d6002de58 [ 585.033181] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.033381] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.033668] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.036256] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.036256] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.036256] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:acc778e0-c04c-430f-89f9-274d6002de58 already deleted. [ 585.036256] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-acc778e0-c04c-430f-89f9-274d6002de58" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.506363] env[65943]: INFO networking_nsxv3.common.synchronization [None req-d0471765-b20a-41c3-8e22-780d351ee2c4 None None] Enqueued Resource ID: cdb13ec1-d22f-4cef-b553-26e8b36dbf4c with Priority: HIGHEST for action port [ 585.506989] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdb13ec1-d22f-4cef-b553-26e8b36dbf4c with Priority: HIGHEST for action port [ 585.507162] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-cdb13ec1-d22f-4cef-b553-26e8b36dbf4c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.508360] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cdb13ec1-d22f-4cef-b553-26e8b36dbf4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.508360] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cdb13ec1-d22f-4cef-b553-26e8b36dbf4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.508360] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cdb13ec1-d22f-4cef-b553-26e8b36dbf4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.508360] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdb13ec1-d22f-4cef-b553-26e8b36dbf4c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.858956] env[65943]: INFO networking_nsxv3.common.synchronization [None req-4ea34ee9-2f9b-4017-b37c-64917a5fd878 None None] Enqueued Resource ID: e1531281-db9c-470d-85fe-63771d7bc83f with Priority: HIGHEST for action port [ 585.859433] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1531281-db9c-470d-85fe-63771d7bc83f with Priority: HIGHEST for action port [ 585.859772] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-e1531281-db9c-470d-85fe-63771d7bc83f taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.859888] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e1531281-db9c-470d-85fe-63771d7bc83f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.859928] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e1531281-db9c-470d-85fe-63771d7bc83f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.860193] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e1531281-db9c-470d-85fe-63771d7bc83f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.860364] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1531281-db9c-470d-85fe-63771d7bc83f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.012043] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cdb13ec1-d22f-4cef-b553-26e8b36dbf4c [ 586.012043] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.012043] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.012043] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.012043] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.012043] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.012043] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cdb13ec1-d22f-4cef-b553-26e8b36dbf4c already deleted. [ 586.012043] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cdb13ec1-d22f-4cef-b553-26e8b36dbf4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.247702] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-651 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.247981] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.248458] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.248770] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.249049] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.249205] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.249318] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.249523] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.249929] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.250248] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 586.250414] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 586.250531] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 586.250636] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 586.250746] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 586.250854] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 586.250983] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 586.270501] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 586.270667] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 586.270806] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 586.270984] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.271330] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-63fcb2f9-c75e-412e-9bdd-0f307d8ae544 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.271521] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-63fcb2f9-c75e-412e-9bdd-0f307d8ae544" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.271647] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-63fcb2f9-c75e-412e-9bdd-0f307d8ae544" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.271993] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-63fcb2f9-c75e-412e-9bdd-0f307d8ae544" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.272714] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63fcb2f9-c75e-412e-9bdd-0f307d8ae544',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.363796] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e1531281-db9c-470d-85fe-63771d7bc83f [ 586.364052] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.364194] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.364263] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.364487] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.364591] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.364692] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e1531281-db9c-470d-85fe-63771d7bc83f already deleted. [ 586.364780] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e1531281-db9c-470d-85fe-63771d7bc83f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.774587] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.774952] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.774952] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.775229] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.775395] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.775563] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port 63fcb2f9-c75e-412e-9bdd-0f307d8ae544 not found, creating... [ 586.775824] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.775972] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.776094] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.776307] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.776437] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.776781] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.776929] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.777123] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.777253] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.777381] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.777504] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: 63fcb2f9-c75e-412e-9bdd-0f307d8ae544 is going to be created. [ 586.803582] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.803774] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.803897] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.804201] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.804430] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.804741] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-63fcb2f9-c75e-412e-9bdd-0f307d8ae544" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.353733] env[65943]: INFO networking_nsxv3.common.synchronization [None req-0a5dce81-316f-4920-9698-8041039030a6 None None] Enqueued Resource ID: b61d4ac3-21af-46b7-b0e2-e7313405b597 with Priority: HIGHEST for action port [ 587.355280] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b61d4ac3-21af-46b7-b0e2-e7313405b597 with Priority: HIGHEST for action port [ 587.355280] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-b61d4ac3-21af-46b7-b0e2-e7313405b597 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.355280] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b61d4ac3-21af-46b7-b0e2-e7313405b597" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.355463] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b61d4ac3-21af-46b7-b0e2-e7313405b597" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.355722] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b61d4ac3-21af-46b7-b0e2-e7313405b597" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.355722] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b61d4ac3-21af-46b7-b0e2-e7313405b597',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.730474] env[65943]: INFO networking_nsxv3.common.synchronization [None req-a2fae08e-7a51-46b5-83f4-82e1878c21c3 None None] Enqueued Resource ID: f608d45c-9901-4af0-a9ff-3903964f78dd with Priority: HIGHEST for action port [ 587.730474] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f608d45c-9901-4af0-a9ff-3903964f78dd with Priority: HIGHEST for action port [ 587.730474] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-f608d45c-9901-4af0-a9ff-3903964f78dd taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.730474] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f608d45c-9901-4af0-a9ff-3903964f78dd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.730474] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f608d45c-9901-4af0-a9ff-3903964f78dd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.730474] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f608d45c-9901-4af0-a9ff-3903964f78dd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.730474] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f608d45c-9901-4af0-a9ff-3903964f78dd',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.856869] env[65943]: INFO networking_nsxv3.common.synchronization [req-58dacb16-2a17-4336-a7be-46dd0b7fd68d req-121b3417-1584-4a9b-a40c-587b2f7a2e58 service nova] Enqueued Resource ID: e550f237-9e27-45ea-9e02-516ac8d2852f with Priority: HIGHEST for action security_group_rules [ 587.856869] env[65943]: INFO networking_nsxv3.common.synchronization [req-58dacb16-2a17-4336-a7be-46dd0b7fd68d req-121b3417-1584-4a9b-a40c-587b2f7a2e58 service nova] Enqueued Resource ID: e550f237-9e27-45ea-9e02-516ac8d2852f with Priority: HIGHEST for action security_group_members [ 587.856869] env[65943]: INFO networking_nsxv3.common.synchronization [req-58dacb16-2a17-4336-a7be-46dd0b7fd68d req-121b3417-1584-4a9b-a40c-587b2f7a2e58 service nova] Enqueued Resource ID: 63fcb2f9-c75e-412e-9bdd-0f307d8ae544 with Priority: HIGHEST for action port [ 587.857452] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e550f237-9e27-45ea-9e02-516ac8d2852f with Priority: HIGHEST for action security_group_rules [ 587.857641] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e550f237-9e27-45ea-9e02-516ac8d2852f with Priority: HIGHEST for action security_group_members [ 587.857820] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63fcb2f9-c75e-412e-9bdd-0f307d8ae544 with Priority: HIGHEST for action port [ 587.858761] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b61d4ac3-21af-46b7-b0e2-e7313405b597 [ 587.859026] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.859105] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.859273] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.859609] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.859609] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.859609] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b61d4ac3-21af-46b7-b0e2-e7313405b597 already deleted. [ 587.859609] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b61d4ac3-21af-46b7-b0e2-e7313405b597" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.859813] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e550f237-9e27-45ea-9e02-516ac8d2852f taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.859908] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.859965] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.860215] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.860298] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e550f237-9e27-45ea-9e02-516ac8d2852f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.861099] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e550f237-9e27-45ea-9e02-516ac8d2852f taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.861197] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.861932] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.861932] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.861932] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.861932] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.861932] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.861932] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.861932] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.862307] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e550f237-9e27-45ea-9e02-516ac8d2852f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.863725] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-63fcb2f9-c75e-412e-9bdd-0f307d8ae544 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.863890] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63fcb2f9-c75e-412e-9bdd-0f307d8ae544" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.865812] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63fcb2f9-c75e-412e-9bdd-0f307d8ae544" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.865812] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63fcb2f9-c75e-412e-9bdd-0f307d8ae544" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.865812] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63fcb2f9-c75e-412e-9bdd-0f307d8ae544',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.107215] env[65943]: INFO networking_nsxv3.common.synchronization [None req-dd81d9fe-4e56-4a75-941b-8b78135a5c08 None None] Enqueued Resource ID: 18af0b28-a59b-4b23-a630-e9b9ec1e5d8b with Priority: HIGHEST for action port [ 588.109445] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18af0b28-a59b-4b23-a630-e9b9ec1e5d8b with Priority: HIGHEST for action port [ 588.109763] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-18af0b28-a59b-4b23-a630-e9b9ec1e5d8b taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.110028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18af0b28-a59b-4b23-a630-e9b9ec1e5d8b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.110028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18af0b28-a59b-4b23-a630-e9b9ec1e5d8b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.110208] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18af0b28-a59b-4b23-a630-e9b9ec1e5d8b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.110291] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18af0b28-a59b-4b23-a630-e9b9ec1e5d8b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.234474] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f608d45c-9901-4af0-a9ff-3903964f78dd [ 588.234745] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.234957] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.234957] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.236656] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.236656] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.236656] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f608d45c-9901-4af0-a9ff-3903964f78dd already deleted. [ 588.236656] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f608d45c-9901-4af0-a9ff-3903964f78dd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.367891] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e550f237-9e27-45ea-9e02-516ac8d2852f taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.367891] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.379099] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e550f237-9e27-45ea-9e02-516ac8d2852f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.380989] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 63fcb2f9-c75e-412e-9bdd-0f307d8ae544 with status ACTIVE [ 588.383119] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.383119] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.383119] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.383913] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.384020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.384228] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.384365] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.384421] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.384543] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.384620] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.384833] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.384926] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.384989] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.387353] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.389084] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.389429] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 63fcb2f9-c75e-412e-9bdd-0f307d8ae544 is going to be updated. [ 588.414031] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.414031] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.414031] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.414031] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.414265] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.414265] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63fcb2f9-c75e-412e-9bdd-0f307d8ae544" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.613119] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 18af0b28-a59b-4b23-a630-e9b9ec1e5d8b [ 588.613479] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.613479] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.613619] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.613771] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.613857] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.614174] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:18af0b28-a59b-4b23-a630-e9b9ec1e5d8b already deleted. [ 588.614321] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18af0b28-a59b-4b23-a630-e9b9ec1e5d8b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.881849] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e550f237-9e27-45ea-9e02-516ac8d2852f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.387329] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.387329] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.387329] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.387489] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.387518] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.387606] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e550f237-9e27-45ea-9e02-516ac8d2852f is going to be created. [ 589.444025] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.444025] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.444025] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.444025] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.444025] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.463924] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e550f237-9e27-45ea-9e02-516ac8d2852f in Status: UNINITIALIZED for 2s [ 590.059207] env[65943]: INFO networking_nsxv3.common.synchronization [None req-c2f7227c-7304-47ab-94ff-381b25c37022 None None] Enqueued Resource ID: 79ea3f02-6b30-49df-8176-d9f8c6f9f78e with Priority: HIGHEST for action port [ 590.059505] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79ea3f02-6b30-49df-8176-d9f8c6f9f78e with Priority: HIGHEST for action port [ 590.059816] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-79ea3f02-6b30-49df-8176-d9f8c6f9f78e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.060018] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79ea3f02-6b30-49df-8176-d9f8c6f9f78e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.060130] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79ea3f02-6b30-49df-8176-d9f8c6f9f78e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.060418] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79ea3f02-6b30-49df-8176-d9f8c6f9f78e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.061070] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79ea3f02-6b30-49df-8176-d9f8c6f9f78e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.120229] env[65943]: INFO networking_nsxv3.common.synchronization [None req-a4a27316-c8c6-447c-8f83-a341dd70f729 None None] Enqueued Resource ID: 64005430-098d-43fb-a64d-b27e3f521480 with Priority: HIGHEST for action port [ 590.120229] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64005430-098d-43fb-a64d-b27e3f521480 with Priority: HIGHEST for action port [ 590.120828] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-64005430-098d-43fb-a64d-b27e3f521480 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.122404] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64005430-098d-43fb-a64d-b27e3f521480" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.122580] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64005430-098d-43fb-a64d-b27e3f521480" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.122962] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64005430-098d-43fb-a64d-b27e3f521480" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.123291] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64005430-098d-43fb-a64d-b27e3f521480',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.563539] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 79ea3f02-6b30-49df-8176-d9f8c6f9f78e [ 590.563774] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.563911] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.563980] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.564380] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.564476] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.564578] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:79ea3f02-6b30-49df-8176-d9f8c6f9f78e already deleted. [ 590.564660] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79ea3f02-6b30-49df-8176-d9f8c6f9f78e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.626266] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 64005430-098d-43fb-a64d-b27e3f521480 [ 590.626718] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.626718] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.626718] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.626942] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.626978] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.627107] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:64005430-098d-43fb-a64d-b27e3f521480 already deleted. [ 590.627164] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64005430-098d-43fb-a64d-b27e3f521480" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.482577] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e550f237-9e27-45ea-9e02-516ac8d2852f in Status: SUCCESS [ 591.482971] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.483261] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.483614] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.483786] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.484035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.484108] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.484500] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.484500] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.484628] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.484697] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e550f237-9e27-45ea-9e02-516ac8d2852f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.988621] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e550f237-9e27-45ea-9e02-516ac8d2852f taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.988791] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.988859] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.989277] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.989637] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.989742] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.989742] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.989959] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.990071] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.990166] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.990359] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e550f237-9e27-45ea-9e02-516ac8d2852f taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.990552] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.990552] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.990689] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.990837] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.990954] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.991033] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.991181] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.991260] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.991347] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.991436] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e550f237-9e27-45ea-9e02-516ac8d2852f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.281534] env[65943]: INFO networking_nsxv3.common.synchronization [None req-dce4867a-c0ef-400d-bbeb-7bb879b132ae None None] Enqueued Resource ID: e252f1b1-ca38-44fb-a530-34e30778a67f with Priority: HIGHEST for action port [ 592.282460] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e252f1b1-ca38-44fb-a530-34e30778a67f with Priority: HIGHEST for action port [ 592.282729] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-e252f1b1-ca38-44fb-a530-34e30778a67f taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.282838] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e252f1b1-ca38-44fb-a530-34e30778a67f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.282898] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e252f1b1-ca38-44fb-a530-34e30778a67f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.287187] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e252f1b1-ca38-44fb-a530-34e30778a67f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.287187] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e252f1b1-ca38-44fb-a530-34e30778a67f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.499288] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e550f237-9e27-45ea-9e02-516ac8d2852f: rpc.has_security_group_logging(os_id): False [ 592.517195] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.517410] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.517485] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.517711] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.517809] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.518016] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.518250] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.518250] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.518342] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.518404] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.518594] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.518704] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.518772] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.518947] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.518994] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.520840] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.520840] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.520939] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.521054] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.521176] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.522180] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e550f237-9e27-45ea-9e02-516ac8d2852f is going to be created. [ 592.599698] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.599845] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.599974] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.600217] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.600302] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.609771] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e550f237-9e27-45ea-9e02-516ac8d2852f in Status: IN_PROGRESS for 2s [ 592.692905] env[65943]: INFO networking_nsxv3.common.synchronization [None req-7ca21190-3eda-4d59-b636-4aa1d8f18ee7 None None] Enqueued Resource ID: d4bae344-5446-4b5b-88e3-071d9f56ac71 with Priority: HIGHEST for action port [ 592.693488] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4bae344-5446-4b5b-88e3-071d9f56ac71 with Priority: HIGHEST for action port [ 592.693791] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4bae344-5446-4b5b-88e3-071d9f56ac71 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.693917] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4bae344-5446-4b5b-88e3-071d9f56ac71" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.693982] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4bae344-5446-4b5b-88e3-071d9f56ac71" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.694383] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4bae344-5446-4b5b-88e3-071d9f56ac71" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.695403] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4bae344-5446-4b5b-88e3-071d9f56ac71',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.788558] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e252f1b1-ca38-44fb-a530-34e30778a67f [ 592.788812] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.788941] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.789017] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.789240] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.789327] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.789426] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e252f1b1-ca38-44fb-a530-34e30778a67f already deleted. [ 592.789505] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e252f1b1-ca38-44fb-a530-34e30778a67f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.199306] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d4bae344-5446-4b5b-88e3-071d9f56ac71 [ 593.199595] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.199724] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.199724] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.200339] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.200339] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.200339] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d4bae344-5446-4b5b-88e3-071d9f56ac71 already deleted. [ 593.200339] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4bae344-5446-4b5b-88e3-071d9f56ac71" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.699801] env[65943]: INFO networking_nsxv3.common.synchronization [None req-e821d4e5-0a28-4db5-8e79-afcf33631ecc None None] Enqueued Resource ID: 2a33773b-1cf9-497b-bdb9-ebc37f53ad2e with Priority: HIGHEST for action port [ 593.700144] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a33773b-1cf9-497b-bdb9-ebc37f53ad2e with Priority: HIGHEST for action port [ 593.700688] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a33773b-1cf9-497b-bdb9-ebc37f53ad2e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.700799] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a33773b-1cf9-497b-bdb9-ebc37f53ad2e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.700865] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a33773b-1cf9-497b-bdb9-ebc37f53ad2e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.702782] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a33773b-1cf9-497b-bdb9-ebc37f53ad2e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.702782] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a33773b-1cf9-497b-bdb9-ebc37f53ad2e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.207330] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2a33773b-1cf9-497b-bdb9-ebc37f53ad2e [ 594.207330] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.207330] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.207330] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.207330] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.207330] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.207330] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2a33773b-1cf9-497b-bdb9-ebc37f53ad2e already deleted. [ 594.207330] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a33773b-1cf9-497b-bdb9-ebc37f53ad2e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.588824] env[65943]: INFO networking_nsxv3.common.synchronization [None req-55598633-d8f9-4544-8f2d-6c1c10065622 None None] Enqueued Resource ID: 06cc7cea-9d40-4e20-ac6d-78601e914b59 with Priority: HIGHEST for action port [ 594.589435] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06cc7cea-9d40-4e20-ac6d-78601e914b59 with Priority: HIGHEST for action port [ 594.589710] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-06cc7cea-9d40-4e20-ac6d-78601e914b59 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.589833] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06cc7cea-9d40-4e20-ac6d-78601e914b59" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.590100] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06cc7cea-9d40-4e20-ac6d-78601e914b59" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.590527] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06cc7cea-9d40-4e20-ac6d-78601e914b59" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.590682] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06cc7cea-9d40-4e20-ac6d-78601e914b59',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.623632] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e550f237-9e27-45ea-9e02-516ac8d2852f in Status: SUCCESS [ 594.624228] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.889531] env[65943]: INFO networking_nsxv3.common.synchronization [None req-0fe2386a-367a-4078-9e8f-90371a17886a None None] Enqueued Resource ID: 2c19b142-6dbd-48fa-9a4d-74c87a6b0b02 with Priority: HIGHEST for action port [ 594.889531] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c19b142-6dbd-48fa-9a4d-74c87a6b0b02 with Priority: HIGHEST for action port [ 594.889531] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c19b142-6dbd-48fa-9a4d-74c87a6b0b02 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.890455] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c19b142-6dbd-48fa-9a4d-74c87a6b0b02" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.890697] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c19b142-6dbd-48fa-9a4d-74c87a6b0b02" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.891232] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c19b142-6dbd-48fa-9a4d-74c87a6b0b02" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.891558] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c19b142-6dbd-48fa-9a4d-74c87a6b0b02',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.078738] env[65943]: INFO networking_nsxv3.common.synchronization [None req-c85818f7-8af7-444c-8817-e5624acc1c75 tempest-AttachInterfacesTestJSON-882476571 tempest-AttachInterfacesTestJSON-882476571-project-member] Enqueued Resource ID: ab9efec0-c13a-4960-afb7-a800c8e897d8 with Priority: HIGHEST for action security_group_rules [ 595.080991] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab9efec0-c13a-4960-afb7-a800c8e897d8 with Priority: HIGHEST for action security_group_rules [ 595.081955] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab9efec0-c13a-4960-afb7-a800c8e897d8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.082258] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab9efec0-c13a-4960-afb7-a800c8e897d8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.082830] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab9efec0-c13a-4960-afb7-a800c8e897d8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.083220] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab9efec0-c13a-4960-afb7-a800c8e897d8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.083431] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab9efec0-c13a-4960-afb7-a800c8e897d8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.093043] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 06cc7cea-9d40-4e20-ac6d-78601e914b59 [ 595.093477] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.093738] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.093890] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.094189] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.094394] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.094567] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:06cc7cea-9d40-4e20-ac6d-78601e914b59 already deleted. [ 595.094752] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06cc7cea-9d40-4e20-ac6d-78601e914b59" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.221033] env[65943]: INFO networking_nsxv3.common.synchronization [None req-7c45a72d-731f-49ac-9e77-b5b1a1255a87 tempest-AttachInterfacesTestJSON-882476571 tempest-AttachInterfacesTestJSON-882476571-project-member] Enqueued Resource ID: ab9efec0-c13a-4960-afb7-a800c8e897d8 with Priority: HIGHEST for action security_group_rules [ 595.221560] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab9efec0-c13a-4960-afb7-a800c8e897d8 with Priority: HIGHEST for action security_group_rules [ 595.221863] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab9efec0-c13a-4960-afb7-a800c8e897d8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.223016] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab9efec0-c13a-4960-afb7-a800c8e897d8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.395631] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2c19b142-6dbd-48fa-9a4d-74c87a6b0b02 [ 595.397964] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.397964] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.397964] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.397964] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.397964] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.397964] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2c19b142-6dbd-48fa-9a4d-74c87a6b0b02 already deleted. [ 595.397964] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c19b142-6dbd-48fa-9a4d-74c87a6b0b02" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.549058] env[65943]: INFO networking_nsxv3.common.synchronization [None req-079791d4-b7e2-4657-8be5-3449490bd09e None None] Enqueued Resource ID: 45ace0fa-308f-4067-894b-8f5e7b24ed39 with Priority: HIGHEST for action port [ 595.549927] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45ace0fa-308f-4067-894b-8f5e7b24ed39 with Priority: HIGHEST for action port [ 595.549927] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-45ace0fa-308f-4067-894b-8f5e7b24ed39 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.550038] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45ace0fa-308f-4067-894b-8f5e7b24ed39" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.550118] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45ace0fa-308f-4067-894b-8f5e7b24ed39" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.550365] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45ace0fa-308f-4067-894b-8f5e7b24ed39" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.550443] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45ace0fa-308f-4067-894b-8f5e7b24ed39',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.604682] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.605167] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.605167] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.605406] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.605468] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.605555] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab9efec0-c13a-4960-afb7-a800c8e897d8 already deleted. [ 595.605631] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab9efec0-c13a-4960-afb7-a800c8e897d8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.605842] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab9efec0-c13a-4960-afb7-a800c8e897d8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.605990] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab9efec0-c13a-4960-afb7-a800c8e897d8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.606257] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab9efec0-c13a-4960-afb7-a800c8e897d8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.052560] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 45ace0fa-308f-4067-894b-8f5e7b24ed39 [ 596.052560] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.054982] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.054982] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.054982] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.054982] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.054982] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:45ace0fa-308f-4067-894b-8f5e7b24ed39 already deleted. [ 596.054982] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45ace0fa-308f-4067-894b-8f5e7b24ed39" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.128397] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.128397] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.128397] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.129977] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.129977] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.129977] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab9efec0-c13a-4960-afb7-a800c8e897d8 already deleted. [ 596.129977] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab9efec0-c13a-4960-afb7-a800c8e897d8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.565172] env[65943]: INFO networking_nsxv3.common.synchronization [None req-d8889f33-1d6b-4b64-b7f9-434c3e832643 None None] Enqueued Resource ID: 201ee91a-4987-4e84-a5c9-2113663025cd with Priority: HIGHEST for action port [ 596.565777] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 201ee91a-4987-4e84-a5c9-2113663025cd with Priority: HIGHEST for action port [ 596.566422] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-201ee91a-4987-4e84-a5c9-2113663025cd taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.566422] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-201ee91a-4987-4e84-a5c9-2113663025cd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.566422] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-201ee91a-4987-4e84-a5c9-2113663025cd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.566586] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-201ee91a-4987-4e84-a5c9-2113663025cd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.566586] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('201ee91a-4987-4e84-a5c9-2113663025cd',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.048310] env[65943]: INFO networking_nsxv3.common.synchronization [None req-06f8b8ab-bdbb-4ea5-84cc-683efe467dbb tempest-VolumesAssistedSnapshotsTest-1092122238 tempest-VolumesAssistedSnapshotsTest-1092122238-project-member] Enqueued Resource ID: d97ff6f8-41cc-4974-82fe-bda7247ceb2b with Priority: HIGHEST for action security_group_rules [ 597.048966] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d97ff6f8-41cc-4974-82fe-bda7247ceb2b with Priority: HIGHEST for action security_group_rules [ 597.049475] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d97ff6f8-41cc-4974-82fe-bda7247ceb2b taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.049475] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d97ff6f8-41cc-4974-82fe-bda7247ceb2b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.049475] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d97ff6f8-41cc-4974-82fe-bda7247ceb2b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.049660] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d97ff6f8-41cc-4974-82fe-bda7247ceb2b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.049660] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d97ff6f8-41cc-4974-82fe-bda7247ceb2b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.072675] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 201ee91a-4987-4e84-a5c9-2113663025cd [ 597.072985] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.073137] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.073334] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.073432] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.073531] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.073623] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:201ee91a-4987-4e84-a5c9-2113663025cd already deleted. [ 597.073707] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-201ee91a-4987-4e84-a5c9-2113663025cd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.320199] env[65943]: INFO networking_nsxv3.common.synchronization [None req-24bbcb2b-1de0-4e52-a079-b03da6936770 tempest-ServersTestJSON-1580779679 tempest-ServersTestJSON-1580779679-project-member] Enqueued Resource ID: dcee84a2-5f8e-4aff-856c-81b817d31434 with Priority: HIGHEST for action security_group_rules [ 597.320945] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcee84a2-5f8e-4aff-856c-81b817d31434 with Priority: HIGHEST for action security_group_rules [ 597.321204] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dcee84a2-5f8e-4aff-856c-81b817d31434 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.321699] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dcee84a2-5f8e-4aff-856c-81b817d31434" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.321827] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dcee84a2-5f8e-4aff-856c-81b817d31434" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.322251] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dcee84a2-5f8e-4aff-856c-81b817d31434" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.322357] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dcee84a2-5f8e-4aff-856c-81b817d31434',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.432246] env[65943]: INFO networking_nsxv3.common.synchronization [None req-865c8b80-63fb-45e4-a434-c903d5c05412 tempest-VolumesAssistedSnapshotsTest-1092122238 tempest-VolumesAssistedSnapshotsTest-1092122238-project-member] Enqueued Resource ID: d97ff6f8-41cc-4974-82fe-bda7247ceb2b with Priority: HIGHEST for action security_group_rules [ 597.432935] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d97ff6f8-41cc-4974-82fe-bda7247ceb2b with Priority: HIGHEST for action security_group_rules [ 597.433964] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d97ff6f8-41cc-4974-82fe-bda7247ceb2b taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.434091] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d97ff6f8-41cc-4974-82fe-bda7247ceb2b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.476556] env[65943]: INFO networking_nsxv3.common.synchronization [None req-c22da8dc-7b66-4afc-b523-72fac5162862 tempest-ServersTestJSON-1580779679 tempest-ServersTestJSON-1580779679-project-member] Enqueued Resource ID: dcee84a2-5f8e-4aff-856c-81b817d31434 with Priority: HIGHEST for action security_group_rules [ 597.477128] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcee84a2-5f8e-4aff-856c-81b817d31434 with Priority: HIGHEST for action security_group_rules [ 597.477445] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dcee84a2-5f8e-4aff-856c-81b817d31434 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.477546] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dcee84a2-5f8e-4aff-856c-81b817d31434" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.569150] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.569293] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.569522] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.569603] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.569652] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.569746] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d97ff6f8-41cc-4974-82fe-bda7247ceb2b already deleted. [ 597.569827] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d97ff6f8-41cc-4974-82fe-bda7247ceb2b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.569966] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d97ff6f8-41cc-4974-82fe-bda7247ceb2b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.570927] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d97ff6f8-41cc-4974-82fe-bda7247ceb2b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.571955] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d97ff6f8-41cc-4974-82fe-bda7247ceb2b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.848081] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.848081] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.848081] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.848081] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.848081] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.848081] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dcee84a2-5f8e-4aff-856c-81b817d31434 already deleted. [ 597.848081] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dcee84a2-5f8e-4aff-856c-81b817d31434" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.848081] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dcee84a2-5f8e-4aff-856c-81b817d31434" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.848081] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dcee84a2-5f8e-4aff-856c-81b817d31434" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.848081] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dcee84a2-5f8e-4aff-856c-81b817d31434',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.094072] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.094369] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.094369] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.094669] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.094669] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.094759] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d97ff6f8-41cc-4974-82fe-bda7247ceb2b already deleted. [ 598.094840] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d97ff6f8-41cc-4974-82fe-bda7247ceb2b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.212479] env[65943]: INFO networking_nsxv3.common.synchronization [None req-9609d110-bf1e-4954-bcc0-74cc70f3da21 None None] Enqueued Resource ID: b81b1e9a-1810-48a9-91ba-46de664ea4fc with Priority: HIGHEST for action port [ 598.213326] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b81b1e9a-1810-48a9-91ba-46de664ea4fc with Priority: HIGHEST for action port [ 598.214204] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-b81b1e9a-1810-48a9-91ba-46de664ea4fc taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.214204] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b81b1e9a-1810-48a9-91ba-46de664ea4fc" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.214204] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b81b1e9a-1810-48a9-91ba-46de664ea4fc" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.214726] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b81b1e9a-1810-48a9-91ba-46de664ea4fc" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.214889] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b81b1e9a-1810-48a9-91ba-46de664ea4fc',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.372334] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.372334] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.372334] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.372334] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.372334] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.372334] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dcee84a2-5f8e-4aff-856c-81b817d31434 already deleted. [ 598.372334] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dcee84a2-5f8e-4aff-856c-81b817d31434" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.459174] env[65943]: INFO networking_nsxv3.common.synchronization [req-10f11068-f59e-446c-970e-70fa4e99e80e req-6149acad-ea8e-498b-b6e0-0e9da3410ec4 tempest-ServerDiagnosticsNegativeTest-953639815 tempest-ServerDiagnosticsNegativeTest-953639815-project-member] Enqueued Resource ID: fec81ce3-7d2a-43a6-b4de-83696a200925 with Priority: HIGHEST for action security_group_members [ 598.459789] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fec81ce3-7d2a-43a6-b4de-83696a200925 with Priority: HIGHEST for action security_group_members [ 598.460313] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-fec81ce3-7d2a-43a6-b4de-83696a200925 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.460313] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fec81ce3-7d2a-43a6-b4de-83696a200925" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.460313] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fec81ce3-7d2a-43a6-b4de-83696a200925" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.460542] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fec81ce3-7d2a-43a6-b4de-83696a200925" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.460700] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.460810] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.460888] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.461116] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.461202] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.461292] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fec81ce3-7d2a-43a6-b4de-83696a200925',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.719403] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b81b1e9a-1810-48a9-91ba-46de664ea4fc [ 598.719745] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.719863] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.719863] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.720103] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.720188] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.720987] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b81b1e9a-1810-48a9-91ba-46de664ea4fc already deleted. [ 598.720987] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b81b1e9a-1810-48a9-91ba-46de664ea4fc" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.909835] env[65943]: INFO networking_nsxv3.common.synchronization [None req-4fc811fc-a983-4258-a360-bd6837d8ad7b None None] Enqueued Resource ID: 8515cd98-9916-449c-bb61-79bfbdf35325 with Priority: HIGHEST for action port [ 598.910475] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8515cd98-9916-449c-bb61-79bfbdf35325 with Priority: HIGHEST for action port [ 598.910686] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-8515cd98-9916-449c-bb61-79bfbdf35325 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.910823] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8515cd98-9916-449c-bb61-79bfbdf35325" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.910890] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8515cd98-9916-449c-bb61-79bfbdf35325" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.913282] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8515cd98-9916-449c-bb61-79bfbdf35325" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.913343] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8515cd98-9916-449c-bb61-79bfbdf35325',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.963991] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.964205] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.964279] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.964506] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.964600] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.964792] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.965532] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.965626] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.965861] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.965937] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.966043] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fec81ce3-7d2a-43a6-b4de-83696a200925 already deleted. [ 598.966128] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fec81ce3-7d2a-43a6-b4de-83696a200925" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.103025] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-651 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.103406] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.103406] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.103578] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.103833] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.103980] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.104378] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.104378] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.104499] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.104659] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 599.104757] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 599.104893] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 599.105514] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 599.105514] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 599.105514] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 599.105514] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 599.126106] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 599.126274] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 599.126488] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 599.126609] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.126882] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-193470fc-27ae-413d-b42b-c571b2f1f1ed taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.127070] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-193470fc-27ae-413d-b42b-c571b2f1f1ed" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.127190] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-193470fc-27ae-413d-b42b-c571b2f1f1ed" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.127537] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-193470fc-27ae-413d-b42b-c571b2f1f1ed" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.127669] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('193470fc-27ae-413d-b42b-c571b2f1f1ed',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.418070] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8515cd98-9916-449c-bb61-79bfbdf35325 [ 599.418309] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.418459] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.418622] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.418835] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.418924] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.419032] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8515cd98-9916-449c-bb61-79bfbdf35325 already deleted. [ 599.419122] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8515cd98-9916-449c-bb61-79bfbdf35325" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.633944] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.634263] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.634924] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.634924] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.634924] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.635160] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port 193470fc-27ae-413d-b42b-c571b2f1f1ed not found, creating... [ 599.635475] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.635656] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.635802] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.636091] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.636246] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.636615] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.636791] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.636908] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.637178] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.637332] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.637534] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: 193470fc-27ae-413d-b42b-c571b2f1f1ed is going to be created. [ 599.661702] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.661883] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.661921] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.662227] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.662461] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.662988] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-193470fc-27ae-413d-b42b-c571b2f1f1ed" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.424059] env[65943]: INFO networking_nsxv3.common.synchronization [req-10f11068-f59e-446c-970e-70fa4e99e80e req-6f872b93-cb95-4726-9dc0-d902cdf91b52 service nova] Enqueued Resource ID: fec81ce3-7d2a-43a6-b4de-83696a200925 with Priority: HIGHEST for action security_group_rules [ 600.424329] env[65943]: INFO networking_nsxv3.common.synchronization [req-10f11068-f59e-446c-970e-70fa4e99e80e req-6f872b93-cb95-4726-9dc0-d902cdf91b52 service nova] Enqueued Resource ID: fec81ce3-7d2a-43a6-b4de-83696a200925 with Priority: HIGHEST for action security_group_members [ 600.424489] env[65943]: INFO networking_nsxv3.common.synchronization [req-10f11068-f59e-446c-970e-70fa4e99e80e req-6f872b93-cb95-4726-9dc0-d902cdf91b52 service nova] Enqueued Resource ID: 193470fc-27ae-413d-b42b-c571b2f1f1ed with Priority: HIGHEST for action port [ 600.424558] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fec81ce3-7d2a-43a6-b4de-83696a200925 with Priority: HIGHEST for action security_group_rules [ 600.424684] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fec81ce3-7d2a-43a6-b4de-83696a200925 with Priority: HIGHEST for action security_group_members [ 600.424845] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 193470fc-27ae-413d-b42b-c571b2f1f1ed with Priority: HIGHEST for action port [ 600.425411] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fec81ce3-7d2a-43a6-b4de-83696a200925 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.425530] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fec81ce3-7d2a-43a6-b4de-83696a200925" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.425642] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fec81ce3-7d2a-43a6-b4de-83696a200925" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.425840] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fec81ce3-7d2a-43a6-b4de-83696a200925" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.425934] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fec81ce3-7d2a-43a6-b4de-83696a200925',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.426947] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-fec81ce3-7d2a-43a6-b4de-83696a200925 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.426947] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fec81ce3-7d2a-43a6-b4de-83696a200925" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.426947] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fec81ce3-7d2a-43a6-b4de-83696a200925" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.427176] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fec81ce3-7d2a-43a6-b4de-83696a200925" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.427237] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.427332] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.427402] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.427543] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.427625] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.427733] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fec81ce3-7d2a-43a6-b4de-83696a200925',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.428402] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-193470fc-27ae-413d-b42b-c571b2f1f1ed taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.428478] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-193470fc-27ae-413d-b42b-c571b2f1f1ed" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.428543] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-193470fc-27ae-413d-b42b-c571b2f1f1ed" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.428689] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-193470fc-27ae-413d-b42b-c571b2f1f1ed" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.428761] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('193470fc-27ae-413d-b42b-c571b2f1f1ed',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.521057] env[65943]: INFO networking_nsxv3.common.synchronization [None req-e1df189c-6630-4008-96c1-0314aca9a12e tempest-ServersTestBootFromVolume-62984311 tempest-ServersTestBootFromVolume-62984311-project-member] Enqueued Resource ID: 1059706e-9846-4d25-98c7-43c5aa686d19 with Priority: HIGHEST for action security_group_rules [ 600.521452] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1059706e-9846-4d25-98c7-43c5aa686d19 with Priority: HIGHEST for action security_group_rules [ 600.521563] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1059706e-9846-4d25-98c7-43c5aa686d19 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.521683] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1059706e-9846-4d25-98c7-43c5aa686d19" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.521751] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1059706e-9846-4d25-98c7-43c5aa686d19" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.522110] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1059706e-9846-4d25-98c7-43c5aa686d19" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.522203] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1059706e-9846-4d25-98c7-43c5aa686d19',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.728950] env[65943]: INFO networking_nsxv3.common.synchronization [None req-0cfce626-6339-4f05-aa6d-74c7d772fd62 tempest-ServersTestBootFromVolume-62984311 tempest-ServersTestBootFromVolume-62984311-project-member] Enqueued Resource ID: 1059706e-9846-4d25-98c7-43c5aa686d19 with Priority: HIGHEST for action security_group_rules [ 600.728950] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1059706e-9846-4d25-98c7-43c5aa686d19 with Priority: HIGHEST for action security_group_rules [ 600.729224] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1059706e-9846-4d25-98c7-43c5aa686d19 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.729303] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1059706e-9846-4d25-98c7-43c5aa686d19" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.934120] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-fec81ce3-7d2a-43a6-b4de-83696a200925 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.934248] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fec81ce3-7d2a-43a6-b4de-83696a200925" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.934429] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fec81ce3-7d2a-43a6-b4de-83696a200925',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.935863] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 193470fc-27ae-413d-b42b-c571b2f1f1ed with status ACTIVE [ 600.935863] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.935863] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.935863] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.935863] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.937315] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.937315] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.937315] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.937315] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.937315] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.937315] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.937315] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.937315] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.937315] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.937315] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.938727] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.938727] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 193470fc-27ae-413d-b42b-c571b2f1f1ed is going to be updated. [ 600.960809] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.962307] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.963640] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.963640] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.963640] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.963640] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-193470fc-27ae-413d-b42b-c571b2f1f1ed" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.044533] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.044714] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.044768] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.045370] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.045370] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.045370] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1059706e-9846-4d25-98c7-43c5aa686d19 already deleted. [ 601.045370] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1059706e-9846-4d25-98c7-43c5aa686d19" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.045563] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1059706e-9846-4d25-98c7-43c5aa686d19" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.045664] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1059706e-9846-4d25-98c7-43c5aa686d19" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.045664] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1059706e-9846-4d25-98c7-43c5aa686d19',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.069444] env[65943]: INFO networking_nsxv3.common.synchronization [req-c1b9d8e4-3bee-465d-af94-442662d64ed5 req-3b10a84f-8c34-46cc-83ce-e12177bc13a2 tempest-ServersAdminNegativeTestJSON-33136479 tempest-ServersAdminNegativeTestJSON-33136479-project-member] Enqueued Resource ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 with Priority: HIGHEST for action security_group_members [ 601.069764] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 with Priority: HIGHEST for action security_group_members [ 601.070082] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-df0b5076-3338-4b40-9ce6-994130c4b8d2 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.070229] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.070270] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.071050] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.071050] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.071050] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.071050] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.071050] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.074951] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.075065] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df0b5076-3338-4b40-9ce6-994130c4b8d2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.440496] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fec81ce3-7d2a-43a6-b4de-83696a200925',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.452594] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-651 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.452700] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.453315] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.453315] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.453432] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.453487] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.453584] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.453793] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.453930] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.454673] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 601.454860] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 601.455039] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 601.455212] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 601.455921] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 601.455921] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 601.455921] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 601.475420] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 601.475601] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 601.475695] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 601.475876] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.476933] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-300ef430-b1f7-4d8a-8133-6d76ddf6a255 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.476933] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-300ef430-b1f7-4d8a-8133-6d76ddf6a255" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.476933] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-300ef430-b1f7-4d8a-8133-6d76ddf6a255" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.476933] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-300ef430-b1f7-4d8a-8133-6d76ddf6a255" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.477258] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('300ef430-b1f7-4d8a-8133-6d76ddf6a255',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.553214] env[65943]: INFO networking_nsxv3.common.synchronization [None req-6174ad68-713c-4a25-a203-b668c7eeff92 None None] Enqueued Resource ID: 80d5e620-3fbc-462f-8eb8-005692956fb1 with Priority: HIGHEST for action port [ 601.553484] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80d5e620-3fbc-462f-8eb8-005692956fb1 with Priority: HIGHEST for action port [ 601.554115] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-80d5e620-3fbc-462f-8eb8-005692956fb1 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.554209] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-80d5e620-3fbc-462f-8eb8-005692956fb1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.554302] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-80d5e620-3fbc-462f-8eb8-005692956fb1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.554515] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-80d5e620-3fbc-462f-8eb8-005692956fb1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.554594] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80d5e620-3fbc-462f-8eb8-005692956fb1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.566682] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.566682] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.566682] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.567082] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.567082] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.567082] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1059706e-9846-4d25-98c7-43c5aa686d19 already deleted. [ 601.567218] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1059706e-9846-4d25-98c7-43c5aa686d19" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.581480] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.581621] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.581693] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.581912] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.582749] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.582749] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.582749] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.582749] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.582749] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.582749] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.582749] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 already deleted. [ 601.582749] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.943122] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.943122] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.943122] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.943278] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.943347] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.943606] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fec81ce3-7d2a-43a6-b4de-83696a200925 is going to be created. [ 601.979746] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.979746] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.979746] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.979746] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.980751] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.981755] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.982185] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.982257] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.982538] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.982629] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.982794] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port 300ef430-b1f7-4d8a-8133-6d76ddf6a255 not found, creating... [ 601.983409] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.983409] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.983614] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.983742] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.984472] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.984472] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.984472] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.984472] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.985023] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.985023] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.985023] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: 300ef430-b1f7-4d8a-8133-6d76ddf6a255 is going to be created. [ 602.002391] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fec81ce3-7d2a-43a6-b4de-83696a200925 in Status: UNINITIALIZED for 2s [ 602.024052] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.024052] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.024052] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.024052] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.024052] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.024052] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-300ef430-b1f7-4d8a-8133-6d76ddf6a255" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.056866] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 80d5e620-3fbc-462f-8eb8-005692956fb1 [ 602.057231] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.057425] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.057499] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.057780] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.057912] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.058036] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:80d5e620-3fbc-462f-8eb8-005692956fb1 already deleted. [ 602.058138] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-80d5e620-3fbc-462f-8eb8-005692956fb1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.780647] env[65943]: INFO networking_nsxv3.common.synchronization [req-c1b9d8e4-3bee-465d-af94-442662d64ed5 req-38fb446d-bc65-4fbd-837d-fd6893eccc6e service nova] Enqueued Resource ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 with Priority: HIGHEST for action security_group_rules [ 602.780972] env[65943]: INFO networking_nsxv3.common.synchronization [req-c1b9d8e4-3bee-465d-af94-442662d64ed5 req-38fb446d-bc65-4fbd-837d-fd6893eccc6e service nova] Enqueued Resource ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 with Priority: HIGHEST for action security_group_members [ 602.781038] env[65943]: INFO networking_nsxv3.common.synchronization [req-c1b9d8e4-3bee-465d-af94-442662d64ed5 req-38fb446d-bc65-4fbd-837d-fd6893eccc6e service nova] Enqueued Resource ID: 300ef430-b1f7-4d8a-8133-6d76ddf6a255 with Priority: HIGHEST for action port [ 602.781694] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 with Priority: HIGHEST for action security_group_rules [ 602.782358] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 with Priority: HIGHEST for action security_group_members [ 602.782511] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 300ef430-b1f7-4d8a-8133-6d76ddf6a255 with Priority: HIGHEST for action port [ 602.782902] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df0b5076-3338-4b40-9ce6-994130c4b8d2 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.783316] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.783316] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.783473] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.783638] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df0b5076-3338-4b40-9ce6-994130c4b8d2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.784813] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-df0b5076-3338-4b40-9ce6-994130c4b8d2 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.786478] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.786478] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.786478] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.786478] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.786478] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.786740] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.786740] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.786740] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.786853] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df0b5076-3338-4b40-9ce6-994130c4b8d2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.787677] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-300ef430-b1f7-4d8a-8133-6d76ddf6a255 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.787781] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-300ef430-b1f7-4d8a-8133-6d76ddf6a255" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.788160] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-300ef430-b1f7-4d8a-8133-6d76ddf6a255" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.788160] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-300ef430-b1f7-4d8a-8133-6d76ddf6a255" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.788160] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('300ef430-b1f7-4d8a-8133-6d76ddf6a255',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.290382] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df0b5076-3338-4b40-9ce6-994130c4b8d2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.292147] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-df0b5076-3338-4b40-9ce6-994130c4b8d2 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.292147] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.292147] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 300ef430-b1f7-4d8a-8133-6d76ddf6a255 with status ACTIVE [ 603.293163] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.293163] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.293163] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.293163] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.293163] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.296059] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.296458] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.296458] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.296693] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.296748] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.297040] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.297193] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.297246] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.297450] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.297549] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.297686] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 300ef430-b1f7-4d8a-8133-6d76ddf6a255 is going to be updated. [ 603.302972] env[65943]: INFO networking_nsxv3.common.synchronization [None req-6af8bde3-fc07-4642-991d-a8d91a2821eb tempest-ServerActionsTestJSON-1587559204 tempest-ServerActionsTestJSON-1587559204-project-member] Enqueued Resource ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 with Priority: HIGHEST for action security_group_rules [ 603.304557] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 with Priority: HIGHEST for action security_group_rules [ 603.304920] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.306722] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.307741] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.307741] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.307741] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7bcdadce-edf2-43d0-a8d9-43033bb27e63',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.326741] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.326741] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.326741] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.326741] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.326741] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.327092] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-300ef430-b1f7-4d8a-8133-6d76ddf6a255" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.470440] env[65943]: INFO networking_nsxv3.common.synchronization [None req-4b5c4120-240d-4e00-9137-d0f7a5a79b7d tempest-ServerActionsTestJSON-1587559204 tempest-ServerActionsTestJSON-1587559204-project-member] Enqueued Resource ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 with Priority: HIGHEST for action security_group_rules [ 603.470596] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 with Priority: HIGHEST for action security_group_rules [ 603.470845] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.470950] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.648392] env[65943]: INFO networking_nsxv3.common.synchronization [None req-cd991891-0c3f-4f81-a5b1-467010e4eabb None None] Enqueued Resource ID: 13259fec-b379-442c-a1dd-d8387bcad478 with Priority: HIGHEST for action port [ 603.648951] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13259fec-b379-442c-a1dd-d8387bcad478 with Priority: HIGHEST for action port [ 603.649280] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-13259fec-b379-442c-a1dd-d8387bcad478 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.649419] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13259fec-b379-442c-a1dd-d8387bcad478" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.649486] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13259fec-b379-442c-a1dd-d8387bcad478" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.649984] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13259fec-b379-442c-a1dd-d8387bcad478" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.649984] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13259fec-b379-442c-a1dd-d8387bcad478',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.802103] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df0b5076-3338-4b40-9ce6-994130c4b8d2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.831236] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.831403] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.831444] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.831654] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.831741] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.831829] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 already deleted. [ 603.831930] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.832398] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.832561] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.832661] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7bcdadce-edf2-43d0-a8d9-43033bb27e63',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.014735] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fec81ce3-7d2a-43a6-b4de-83696a200925 in Status: SUCCESS [ 604.015333] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fec81ce3-7d2a-43a6-b4de-83696a200925" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.015492] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fec81ce3-7d2a-43a6-b4de-83696a200925" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.016185] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fec81ce3-7d2a-43a6-b4de-83696a200925" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.016443] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.016595] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.016595] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.017341] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.017470] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.017845] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fec81ce3-7d2a-43a6-b4de-83696a200925" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.018457] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fec81ce3-7d2a-43a6-b4de-83696a200925',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.152213] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 13259fec-b379-442c-a1dd-d8387bcad478 [ 604.152455] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.152587] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.152852] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.153053] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.153415] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.153415] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:13259fec-b379-442c-a1dd-d8387bcad478 already deleted. [ 604.153415] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13259fec-b379-442c-a1dd-d8387bcad478" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.306574] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.307230] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.307230] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.307230] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.307230] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.307230] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 is going to be created. [ 604.350157] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.350411] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.350479] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.350705] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.351387] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.358355] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.358535] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.358575] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.358799] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.358856] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.358947] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 already deleted. [ 604.359048] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.366637] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 in Status: UNINITIALIZED for 2s [ 604.392248] env[65943]: INFO networking_nsxv3.common.synchronization [None req-8501e752-365b-457a-a6f8-919370aa853b None None] Enqueued Resource ID: aa93a7e5-4695-4f94-a555-57c25df8d76e with Priority: HIGHEST for action port [ 604.394612] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa93a7e5-4695-4f94-a555-57c25df8d76e with Priority: HIGHEST for action port [ 604.397152] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa93a7e5-4695-4f94-a555-57c25df8d76e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.397152] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa93a7e5-4695-4f94-a555-57c25df8d76e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.397152] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa93a7e5-4695-4f94-a555-57c25df8d76e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.397152] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa93a7e5-4695-4f94-a555-57c25df8d76e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.397152] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa93a7e5-4695-4f94-a555-57c25df8d76e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.522443] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-fec81ce3-7d2a-43a6-b4de-83696a200925 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.522576] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fec81ce3-7d2a-43a6-b4de-83696a200925" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.522576] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fec81ce3-7d2a-43a6-b4de-83696a200925" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.523162] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fec81ce3-7d2a-43a6-b4de-83696a200925" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.523162] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.523162] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.523162] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.523365] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.523459] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.523548] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fec81ce3-7d2a-43a6-b4de-83696a200925" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.523636] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-fec81ce3-7d2a-43a6-b4de-83696a200925 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.523730] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fec81ce3-7d2a-43a6-b4de-83696a200925" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.523791] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fec81ce3-7d2a-43a6-b4de-83696a200925" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.523931] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fec81ce3-7d2a-43a6-b4de-83696a200925" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.524199] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.524199] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.524343] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.524343] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.524435] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.524554] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fec81ce3-7d2a-43a6-b4de-83696a200925" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.524974] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fec81ce3-7d2a-43a6-b4de-83696a200925',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.900036] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aa93a7e5-4695-4f94-a555-57c25df8d76e [ 604.900036] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.900036] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.900036] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.900505] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.900505] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.900505] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aa93a7e5-4695-4f94-a555-57c25df8d76e already deleted. [ 604.900505] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa93a7e5-4695-4f94-a555-57c25df8d76e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.031024] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fec81ce3-7d2a-43a6-b4de-83696a200925: rpc.has_security_group_logging(os_id): False [ 605.050656] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.050953] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.051103] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.051406] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.051549] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.051798] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.051960] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.051995] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.052205] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.052333] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.052748] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.052748] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.052748] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.053234] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.054420] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.054663] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.054778] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.054820] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.055015] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.055122] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.055339] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fec81ce3-7d2a-43a6-b4de-83696a200925 is going to be created. [ 605.125183] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.125329] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.125329] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.125568] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.125776] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.140273] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fec81ce3-7d2a-43a6-b4de-83696a200925 in Status: IN_PROGRESS for 2s [ 606.376962] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 in Status: SUCCESS [ 606.377247] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.377297] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.377600] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.377855] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.377975] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.378129] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.378300] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.378377] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.378464] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.378578] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df0b5076-3338-4b40-9ce6-994130c4b8d2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.762555] env[65943]: INFO networking_nsxv3.common.synchronization [req-75393fdc-d339-4d5d-94f3-156c8daca9f2 req-5acc2af9-62f7-49f6-9a6c-e268fe32a126 tempest-FloatingIPsAssociationNegativeTestJSON-67475887 tempest-FloatingIPsAssociationNegativeTestJSON-67475887-project-member] Enqueued Resource ID: bf5449c8-e110-49bf-b5ea-dcfeefaf5d48 with Priority: HIGHEST for action security_group_members [ 606.763216] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf5449c8-e110-49bf-b5ea-dcfeefaf5d48 with Priority: HIGHEST for action security_group_members [ 606.763870] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.765072] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.765214] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.766345] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.766583] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.766686] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.766795] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.767048] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.767171] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.767323] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf5449c8-e110-49bf-b5ea-dcfeefaf5d48',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.880668] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-df0b5076-3338-4b40-9ce6-994130c4b8d2 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.880832] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.880914] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.881247] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.881465] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.881582] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.881649] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.881809] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.881902] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.882126] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.882286] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-df0b5076-3338-4b40-9ce6-994130c4b8d2 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.882381] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.882442] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.882630] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.882903] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.883040] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.883157] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.883378] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.883497] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.883607] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.883842] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df0b5076-3338-4b40-9ce6-994130c4b8d2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.000146] env[65943]: INFO networking_nsxv3.common.synchronization [None req-896bb2bb-8c13-4c27-aee3-9a469183cb98 None None] Enqueued Resource ID: 28ba25f3-f031-4b83-bb55-94650378e02a with Priority: HIGHEST for action port [ 607.000146] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28ba25f3-f031-4b83-bb55-94650378e02a with Priority: HIGHEST for action port [ 607.000146] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-28ba25f3-f031-4b83-bb55-94650378e02a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.000146] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28ba25f3-f031-4b83-bb55-94650378e02a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.000146] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28ba25f3-f031-4b83-bb55-94650378e02a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.000792] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28ba25f3-f031-4b83-bb55-94650378e02a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.001056] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28ba25f3-f031-4b83-bb55-94650378e02a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.153850] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fec81ce3-7d2a-43a6-b4de-83696a200925 in Status: SUCCESS [ 607.155046] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fec81ce3-7d2a-43a6-b4de-83696a200925" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.270783] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.273468] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.273468] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.273468] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.273468] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.273468] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.273468] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.273468] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.273468] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.273468] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.273468] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf5449c8-e110-49bf-b5ea-dcfeefaf5d48 already deleted. [ 607.273468] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.387020] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df0b5076-3338-4b40-9ce6-994130c4b8d2: rpc.has_security_group_logging(os_id): False [ 607.412084] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.412273] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.412341] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.412566] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.412660] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.412887] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.412979] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.413053] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.413234] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.413402] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.413513] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.413738] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.413738] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.413809] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.413858] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.414942] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.414942] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.414942] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.414942] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.414942] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.414942] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 is going to be created. [ 607.493661] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.494036] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.494036] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.494157] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.494345] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.504962] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 28ba25f3-f031-4b83-bb55-94650378e02a [ 607.504962] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.504962] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.504962] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.504962] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.504962] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.504962] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:28ba25f3-f031-4b83-bb55-94650378e02a already deleted. [ 607.504962] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28ba25f3-f031-4b83-bb55-94650378e02a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.508009] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 in Status: IN_PROGRESS for 2s [ 607.575336] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-442 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.575518] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-442" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.575633] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-442" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.576019] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-442" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.576220] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.576385] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.576470] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.576681] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.576817] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.577054] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.577148] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 607.577257] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 607.577366] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 607.577471] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.577570] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 607.577694] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 607.608406] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 607.608406] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 607.608406] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 607.608406] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-442" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.608406] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-907c6cdb-8b83-48bd-b701-b52791f12f97 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.608904] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-907c6cdb-8b83-48bd-b701-b52791f12f97" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.608904] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-907c6cdb-8b83-48bd-b701-b52791f12f97" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.608904] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-907c6cdb-8b83-48bd-b701-b52791f12f97" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.609058] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('907c6cdb-8b83-48bd-b701-b52791f12f97',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.111948] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.113543] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.113543] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.113543] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.113543] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.113543] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port 907c6cdb-8b83-48bd-b701-b52791f12f97 not found, creating... [ 608.113543] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.113543] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.113543] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.114264] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.114264] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.114264] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.114264] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.114410] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.114552] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.114683] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.114838] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: 907c6cdb-8b83-48bd-b701-b52791f12f97 is going to be created. [ 608.136789] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.136998] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.137129] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.137406] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.137637] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.137866] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-907c6cdb-8b83-48bd-b701-b52791f12f97" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.877895] env[65943]: INFO networking_nsxv3.common.synchronization [req-75393fdc-d339-4d5d-94f3-156c8daca9f2 req-a1a95120-bdb2-450f-ac91-f6c100f4cb1e service nova] Enqueued Resource ID: bf5449c8-e110-49bf-b5ea-dcfeefaf5d48 with Priority: HIGHEST for action security_group_rules [ 608.878537] env[65943]: INFO networking_nsxv3.common.synchronization [req-75393fdc-d339-4d5d-94f3-156c8daca9f2 req-a1a95120-bdb2-450f-ac91-f6c100f4cb1e service nova] Enqueued Resource ID: bf5449c8-e110-49bf-b5ea-dcfeefaf5d48 with Priority: HIGHEST for action security_group_members [ 608.878537] env[65943]: INFO networking_nsxv3.common.synchronization [req-75393fdc-d339-4d5d-94f3-156c8daca9f2 req-a1a95120-bdb2-450f-ac91-f6c100f4cb1e service nova] Enqueued Resource ID: 907c6cdb-8b83-48bd-b701-b52791f12f97 with Priority: HIGHEST for action port [ 608.880604] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf5449c8-e110-49bf-b5ea-dcfeefaf5d48 with Priority: HIGHEST for action security_group_rules [ 608.880604] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf5449c8-e110-49bf-b5ea-dcfeefaf5d48 with Priority: HIGHEST for action security_group_members [ 608.880604] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 907c6cdb-8b83-48bd-b701-b52791f12f97 with Priority: HIGHEST for action port [ 608.880604] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.880604] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.880604] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.880956] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.881114] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf5449c8-e110-49bf-b5ea-dcfeefaf5d48',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.882231] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.882387] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.882472] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.882717] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.883816] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.884074] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.884154] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.884395] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.884638] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.884756] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf5449c8-e110-49bf-b5ea-dcfeefaf5d48',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.889024] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-907c6cdb-8b83-48bd-b701-b52791f12f97 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.889024] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-907c6cdb-8b83-48bd-b701-b52791f12f97" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.889024] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-907c6cdb-8b83-48bd-b701-b52791f12f97" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.889024] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-907c6cdb-8b83-48bd-b701-b52791f12f97" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.889024] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('907c6cdb-8b83-48bd-b701-b52791f12f97',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.247032] env[65943]: INFO networking_nsxv3.common.synchronization [None req-3a2eb2bd-6a94-4080-8ad9-71246063d009 None None] Enqueued Resource ID: 586a44ea-12ce-4013-8d61-bd8a73e871f6 with Priority: HIGHEST for action port [ 609.247799] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 586a44ea-12ce-4013-8d61-bd8a73e871f6 with Priority: HIGHEST for action port [ 609.248265] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-586a44ea-12ce-4013-8d61-bd8a73e871f6 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.248403] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-586a44ea-12ce-4013-8d61-bd8a73e871f6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.248469] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-586a44ea-12ce-4013-8d61-bd8a73e871f6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.248717] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-586a44ea-12ce-4013-8d61-bd8a73e871f6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.248886] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('586a44ea-12ce-4013-8d61-bd8a73e871f6',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.389016] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bf5449c8-e110-49bf-b5ea-dcfeefaf5d48',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.390912] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.392252] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.392252] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 907c6cdb-8b83-48bd-b701-b52791f12f97 with status ACTIVE [ 609.392485] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.392485] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.392485] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.392716] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.392809] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.392986] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.393236] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.393323] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.393515] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.393823] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.393823] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.395536] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.395536] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.395536] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.395536] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.395536] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 907c6cdb-8b83-48bd-b701-b52791f12f97 is going to be updated. [ 609.400085] env[65943]: INFO networking_nsxv3.common.synchronization [req-c0329fff-7777-4d2c-b3f6-e45d1b432cc4 req-98985786-9a4b-49e4-a9ac-9906dd2a59b3 tempest-ServersAdminTestJSON-910281195 tempest-ServersAdminTestJSON-910281195-project-member] Enqueued Resource ID: e02be8c7-70b1-4488-b079-b1ebf20a733c with Priority: HIGHEST for action security_group_members [ 609.400939] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e02be8c7-70b1-4488-b079-b1ebf20a733c with Priority: HIGHEST for action security_group_members [ 609.401804] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e02be8c7-70b1-4488-b079-b1ebf20a733c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.401804] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.401804] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.401804] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.401998] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.401998] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.402091] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.402325] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.402325] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.402433] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.425190] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.425190] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.425190] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.425190] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.425190] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.425190] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-907c6cdb-8b83-48bd-b701-b52791f12f97" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.527565] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 in Status: SUCCESS [ 609.527565] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.751768] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 586a44ea-12ce-4013-8d61-bd8a73e871f6 [ 609.752018] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.752151] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.752219] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.752446] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.752587] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.752633] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:586a44ea-12ce-4013-8d61-bd8a73e871f6 already deleted. [ 609.753324] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-586a44ea-12ce-4013-8d61-bd8a73e871f6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.841730] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-581 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.841730] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-581" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.841730] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-581" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.841730] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-581" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.841730] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.841730] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.841730] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.841730] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.841730] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.842179] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 609.842179] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 609.842179] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 609.842179] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 609.842316] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 609.842349] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 609.842457] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 609.861134] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 609.861293] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 609.861422] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 609.861594] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-581" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.861978] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-c919fc14-4ce7-420b-ad11-a7620f25c29a taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.862111] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-c919fc14-4ce7-420b-ad11-a7620f25c29a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.862188] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-c919fc14-4ce7-420b-ad11-a7620f25c29a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.862505] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-c919fc14-4ce7-420b-ad11-a7620f25c29a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.862640] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c919fc14-4ce7-420b-ad11-a7620f25c29a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.898890] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bf5449c8-e110-49bf-b5ea-dcfeefaf5d48',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.906712] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.906868] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.906937] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.907172] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.907280] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.907483] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.907605] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.907671] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.907830] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.907908] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.907994] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e02be8c7-70b1-4488-b079-b1ebf20a733c already deleted. [ 609.908084] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.367754] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.367990] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.368138] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.368544] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.368725] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.368889] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port c919fc14-4ce7-420b-ad11-a7620f25c29a not found, creating... [ 610.369192] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.369386] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.369515] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.369749] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.369880] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.370255] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.370406] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.370513] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.370711] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.370833] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.370962] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: c919fc14-4ce7-420b-ad11-a7620f25c29a is going to be created. [ 610.393663] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.393957] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.394046] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.394303] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.395095] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.395095] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-c919fc14-4ce7-420b-ad11-a7620f25c29a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.402254] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.402382] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.402452] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.402648] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.402734] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.402826] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf5449c8-e110-49bf-b5ea-dcfeefaf5d48 is going to be created. [ 610.431585] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.431585] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.431585] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.431585] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.431777] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.443560] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf5449c8-e110-49bf-b5ea-dcfeefaf5d48 in Status: UNINITIALIZED for 2s [ 611.223774] env[65943]: INFO networking_nsxv3.common.synchronization [req-c0329fff-7777-4d2c-b3f6-e45d1b432cc4 req-a0ab0f6f-f531-47b2-87e2-7434ce84a48d service nova] Enqueued Resource ID: e02be8c7-70b1-4488-b079-b1ebf20a733c with Priority: HIGHEST for action security_group_rules [ 611.224133] env[65943]: INFO networking_nsxv3.common.synchronization [req-c0329fff-7777-4d2c-b3f6-e45d1b432cc4 req-a0ab0f6f-f531-47b2-87e2-7434ce84a48d service nova] Enqueued Resource ID: e02be8c7-70b1-4488-b079-b1ebf20a733c with Priority: HIGHEST for action security_group_members [ 611.224583] env[65943]: INFO networking_nsxv3.common.synchronization [req-c0329fff-7777-4d2c-b3f6-e45d1b432cc4 req-a0ab0f6f-f531-47b2-87e2-7434ce84a48d service nova] Enqueued Resource ID: c919fc14-4ce7-420b-ad11-a7620f25c29a with Priority: HIGHEST for action port [ 611.225205] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e02be8c7-70b1-4488-b079-b1ebf20a733c with Priority: HIGHEST for action security_group_rules [ 611.225373] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e02be8c7-70b1-4488-b079-b1ebf20a733c with Priority: HIGHEST for action security_group_members [ 611.225477] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c919fc14-4ce7-420b-ad11-a7620f25c29a with Priority: HIGHEST for action port [ 611.225791] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e02be8c7-70b1-4488-b079-b1ebf20a733c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.225939] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.226027] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.226384] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.226384] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.227360] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e02be8c7-70b1-4488-b079-b1ebf20a733c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.227502] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.227564] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.227846] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.227962] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.228287] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.228378] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.228616] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.228812] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.228896] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.230521] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-c919fc14-4ce7-420b-ad11-a7620f25c29a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.230690] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c919fc14-4ce7-420b-ad11-a7620f25c29a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.230904] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c919fc14-4ce7-420b-ad11-a7620f25c29a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.231340] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c919fc14-4ce7-420b-ad11-a7620f25c29a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.231340] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c919fc14-4ce7-420b-ad11-a7620f25c29a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.508716] env[65943]: INFO networking_nsxv3.common.synchronization [req-322e6d03-a229-41c8-be11-a58bcfd1c9ad req-8e14a876-5a7b-4a6f-8671-80c8d2b7ae9f tempest-AttachInterfacesV270Test-1116323746 tempest-AttachInterfacesV270Test-1116323746-project-member] Enqueued Resource ID: 4d0b6f8c-385a-4740-8634-e522537eba0d with Priority: HIGHEST for action security_group_members [ 611.509377] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d0b6f8c-385a-4740-8634-e522537eba0d with Priority: HIGHEST for action security_group_members [ 611.510023] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d0b6f8c-385a-4740-8634-e522537eba0d taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.510160] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d0b6f8c-385a-4740-8634-e522537eba0d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.510251] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d0b6f8c-385a-4740-8634-e522537eba0d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.510466] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d0b6f8c-385a-4740-8634-e522537eba0d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.510626] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.510732] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.510832] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.510958] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.511036] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.511135] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d0b6f8c-385a-4740-8634-e522537eba0d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.736867] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.738421] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e02be8c7-70b1-4488-b079-b1ebf20a733c taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.740206] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.740206] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c919fc14-4ce7-420b-ad11-a7620f25c29a with status ACTIVE [ 611.741982] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.742852] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.742852] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.742852] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.742852] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.742852] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.743258] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.743509] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.743826] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.744026] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.744314] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.744523] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.744661] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.746781] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.746781] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.746781] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c919fc14-4ce7-420b-ad11-a7620f25c29a is going to be updated. [ 611.770746] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.771050] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.771152] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.771545] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.771545] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.771658] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c919fc14-4ce7-420b-ad11-a7620f25c29a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.943059] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-271 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.943445] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-271" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.943695] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-271" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.944204] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-271" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.945164] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.945611] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.945860] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.946307] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.946683] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.947057] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 611.947301] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 611.947543] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 611.947760] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 611.947995] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 611.948251] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 611.948510] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 611.970872] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 611.971195] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 611.971284] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 611.971517] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-271" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.971924] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-38878f3e-b1ab-463e-922b-62a5de9fd79a taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.972182] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-38878f3e-b1ab-463e-922b-62a5de9fd79a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.972461] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-38878f3e-b1ab-463e-922b-62a5de9fd79a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.972779] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-38878f3e-b1ab-463e-922b-62a5de9fd79a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.973053] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38878f3e-b1ab-463e-922b-62a5de9fd79a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.976020] env[65943]: INFO networking_nsxv3.common.synchronization [None req-13c6c347-5b10-432e-8fc0-e0c8b77eefc2 None None] Enqueued Resource ID: 4227826f-dab5-448e-a97e-16b843bb9153 with Priority: HIGHEST for action port [ 611.976836] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4227826f-dab5-448e-a97e-16b843bb9153 with Priority: HIGHEST for action port [ 611.977338] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-4227826f-dab5-448e-a97e-16b843bb9153 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.977500] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4227826f-dab5-448e-a97e-16b843bb9153" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.977500] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4227826f-dab5-448e-a97e-16b843bb9153" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.977836] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4227826f-dab5-448e-a97e-16b843bb9153" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.978240] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4227826f-dab5-448e-a97e-16b843bb9153',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.012873] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.013107] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.013211] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.013474] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.013609] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.013841] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.013944] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.014109] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.014552] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.014552] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.014552] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d0b6f8c-385a-4740-8634-e522537eba0d already deleted. [ 612.014683] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d0b6f8c-385a-4740-8634-e522537eba0d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.238567] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.458520] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf5449c8-e110-49bf-b5ea-dcfeefaf5d48 in Status: SUCCESS [ 612.458520] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.458520] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.458520] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.458520] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.458520] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.458520] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.458520] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.458520] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.458520] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.458520] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bf5449c8-e110-49bf-b5ea-dcfeefaf5d48',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.477135] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.477407] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.477531] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.477853] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.478032] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.478198] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port 38878f3e-b1ab-463e-922b-62a5de9fd79a not found, creating... [ 612.478496] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.479020] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.479020] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.479172] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.479223] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.479768] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.479768] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.483083] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.483083] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.483083] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.483083] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: 38878f3e-b1ab-463e-922b-62a5de9fd79a is going to be created. [ 612.483083] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4227826f-dab5-448e-a97e-16b843bb9153 [ 612.483083] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.483083] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.483083] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.483083] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.483083] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.483083] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4227826f-dab5-448e-a97e-16b843bb9153 already deleted. [ 612.483083] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4227826f-dab5-448e-a97e-16b843bb9153" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.507147] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.507319] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.507447] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.507797] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.508126] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.508381] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-38878f3e-b1ab-463e-922b-62a5de9fd79a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.741012] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.741337] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.741455] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.741775] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.741899] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.742043] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e02be8c7-70b1-4488-b079-b1ebf20a733c is going to be created. [ 612.772590] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.772734] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.772797] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.773045] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.773168] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.785885] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e02be8c7-70b1-4488-b079-b1ebf20a733c in Status: UNINITIALIZED for 2s [ 612.960652] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.960842] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.960884] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.961208] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.961327] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.961427] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.961482] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.961619] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.961715] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.961992] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.961992] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.962232] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.962232] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.962329] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.962512] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.962512] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.962512] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.963169] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.963169] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.963169] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.963169] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bf5449c8-e110-49bf-b5ea-dcfeefaf5d48',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.315229] env[65943]: INFO networking_nsxv3.common.synchronization [req-322e6d03-a229-41c8-be11-a58bcfd1c9ad req-12587cef-b1cb-4765-b38a-903cfeb4f2c2 service nova] Enqueued Resource ID: 4d0b6f8c-385a-4740-8634-e522537eba0d with Priority: HIGHEST for action security_group_rules [ 613.315632] env[65943]: INFO networking_nsxv3.common.synchronization [req-322e6d03-a229-41c8-be11-a58bcfd1c9ad req-12587cef-b1cb-4765-b38a-903cfeb4f2c2 service nova] Enqueued Resource ID: 4d0b6f8c-385a-4740-8634-e522537eba0d with Priority: HIGHEST for action security_group_members [ 613.315632] env[65943]: INFO networking_nsxv3.common.synchronization [req-322e6d03-a229-41c8-be11-a58bcfd1c9ad req-12587cef-b1cb-4765-b38a-903cfeb4f2c2 service nova] Enqueued Resource ID: 38878f3e-b1ab-463e-922b-62a5de9fd79a with Priority: HIGHEST for action port [ 613.317382] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d0b6f8c-385a-4740-8634-e522537eba0d with Priority: HIGHEST for action security_group_rules [ 613.317576] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d0b6f8c-385a-4740-8634-e522537eba0d with Priority: HIGHEST for action security_group_members [ 613.317680] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38878f3e-b1ab-463e-922b-62a5de9fd79a with Priority: HIGHEST for action port [ 613.318105] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d0b6f8c-385a-4740-8634-e522537eba0d taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.318105] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d0b6f8c-385a-4740-8634-e522537eba0d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.318247] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d0b6f8c-385a-4740-8634-e522537eba0d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.318421] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d0b6f8c-385a-4740-8634-e522537eba0d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.318507] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d0b6f8c-385a-4740-8634-e522537eba0d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.319547] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d0b6f8c-385a-4740-8634-e522537eba0d taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.319679] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d0b6f8c-385a-4740-8634-e522537eba0d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.319795] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d0b6f8c-385a-4740-8634-e522537eba0d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.320104] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d0b6f8c-385a-4740-8634-e522537eba0d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.320316] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.320429] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.320493] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.320733] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.320844] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.320981] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d0b6f8c-385a-4740-8634-e522537eba0d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.321851] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-38878f3e-b1ab-463e-922b-62a5de9fd79a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.322919] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38878f3e-b1ab-463e-922b-62a5de9fd79a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.322919] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38878f3e-b1ab-463e-922b-62a5de9fd79a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.322919] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38878f3e-b1ab-463e-922b-62a5de9fd79a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.322919] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38878f3e-b1ab-463e-922b-62a5de9fd79a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.465254] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bf5449c8-e110-49bf-b5ea-dcfeefaf5d48: rpc.has_security_group_logging(os_id): False [ 613.487269] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.487457] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.487507] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.487720] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.487894] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.488087] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.488210] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.488259] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.488684] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.488684] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.488804] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.488882] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.488924] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.492968] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.493107] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.493360] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.493470] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.493555] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.493716] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.493818] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.493918] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf5449c8-e110-49bf-b5ea-dcfeefaf5d48 is going to be created. [ 613.565925] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.566252] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.566335] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.566577] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.566773] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.583250] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf5449c8-e110-49bf-b5ea-dcfeefaf5d48 in Status: IN_PROGRESS for 2s [ 613.824514] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d0b6f8c-385a-4740-8634-e522537eba0d taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.824681] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d0b6f8c-385a-4740-8634-e522537eba0d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.828368] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4d0b6f8c-385a-4740-8634-e522537eba0d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.829430] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 38878f3e-b1ab-463e-922b-62a5de9fd79a with status ACTIVE [ 613.829704] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.829868] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.829949] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.830194] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.830299] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.830494] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.830598] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.830687] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.830882] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.830967] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.831188] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.831285] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.831357] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.831553] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.831625] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.831726] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 38878f3e-b1ab-463e-922b-62a5de9fd79a is going to be updated. [ 613.861612] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.861914] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.861914] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.862179] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.862250] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.862430] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38878f3e-b1ab-463e-922b-62a5de9fd79a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.896240] env[65943]: INFO networking_nsxv3.common.synchronization [req-51958fc0-6b80-4b5e-a698-f7ba6c34b720 req-2ac3b0cc-46b5-4cb1-8dc0-77fb387fdddd tempest-DeleteServersAdminTestJSON-857689314 tempest-DeleteServersAdminTestJSON-857689314-project-admin] Enqueued Resource ID: e550f237-9e27-45ea-9e02-516ac8d2852f with Priority: HIGHEST for action security_group_members [ 613.896996] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e550f237-9e27-45ea-9e02-516ac8d2852f with Priority: HIGHEST for action security_group_members [ 613.897464] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e550f237-9e27-45ea-9e02-516ac8d2852f taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.897656] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.897766] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.898079] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.898325] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.898484] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.898583] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.898837] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.898967] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.899128] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e550f237-9e27-45ea-9e02-516ac8d2852f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.337273] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4d0b6f8c-385a-4740-8634-e522537eba0d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.404039] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.404039] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.404039] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.404039] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.404039] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.404039] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.404039] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.404039] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.404039] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.404039] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.404039] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e550f237-9e27-45ea-9e02-516ac8d2852f is going to be updated. [ 614.456594] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.458410] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.458410] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.458410] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.458410] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.470290] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e550f237-9e27-45ea-9e02-516ac8d2852f in Status: IN_PROGRESS for 2s [ 614.477632] env[65943]: INFO networking_nsxv3.common.synchronization [req-2c7c4cb8-ffec-4f50-b52e-ec7df958b5e4 req-0358575d-966b-487f-9c3a-e62cdf9dfb41 tempest-AttachInterfacesTestJSON-882476571 tempest-AttachInterfacesTestJSON-882476571-project-member] Enqueued Resource ID: ab9efec0-c13a-4960-afb7-a800c8e897d8 with Priority: HIGHEST for action security_group_members [ 614.478043] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab9efec0-c13a-4960-afb7-a800c8e897d8 with Priority: HIGHEST for action security_group_members [ 614.478644] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab9efec0-c13a-4960-afb7-a800c8e897d8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.478644] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab9efec0-c13a-4960-afb7-a800c8e897d8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.478644] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab9efec0-c13a-4960-afb7-a800c8e897d8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.478893] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab9efec0-c13a-4960-afb7-a800c8e897d8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.478893] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.479619] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.479868] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.480014] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.480014] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.480138] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab9efec0-c13a-4960-afb7-a800c8e897d8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.800029] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e02be8c7-70b1-4488-b079-b1ebf20a733c in Status: SUCCESS [ 614.800029] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.800029] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.800029] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.800029] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.800029] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.800029] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.800029] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.800029] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.800029] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.800029] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.842317] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.842317] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.842317] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.842317] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.842317] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.842317] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d0b6f8c-385a-4740-8634-e522537eba0d is going to be created. [ 614.867590] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.867590] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.867590] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.867590] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.867590] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.877056] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d0b6f8c-385a-4740-8634-e522537eba0d in Status: UNINITIALIZED for 2s [ 614.882534] env[65943]: INFO networking_nsxv3.common.synchronization [None req-a3f8dd47-8dde-4935-bbdf-8d5ad4ca5dc2 None None] Enqueued Resource ID: 634e6dfa-30e0-4408-beda-a5ebd13f7971 with Priority: HIGHEST for action port [ 614.882534] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 634e6dfa-30e0-4408-beda-a5ebd13f7971 with Priority: HIGHEST for action port [ 614.882534] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-634e6dfa-30e0-4408-beda-a5ebd13f7971 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.882534] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-634e6dfa-30e0-4408-beda-a5ebd13f7971" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.882534] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-634e6dfa-30e0-4408-beda-a5ebd13f7971" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.882934] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-634e6dfa-30e0-4408-beda-a5ebd13f7971" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.883218] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('634e6dfa-30e0-4408-beda-a5ebd13f7971',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.905872] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-916 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.906900] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-916" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.909024] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-916" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.909024] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-916" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.909024] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.909024] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.909024] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.909373] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.909637] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.909971] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 614.910279] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 614.910500] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 614.913083] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 614.913083] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 614.913083] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 614.913083] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 614.935644] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 614.938321] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 614.938321] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 614.938321] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-916" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.938321] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-66c24191-101c-4ff5-b083-c2c9d4b7be4d taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.938321] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-66c24191-101c-4ff5-b083-c2c9d4b7be4d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.938321] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-66c24191-101c-4ff5-b083-c2c9d4b7be4d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.938321] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-66c24191-101c-4ff5-b083-c2c9d4b7be4d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.938321] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66c24191-101c-4ff5-b083-c2c9d4b7be4d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.985617] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.985617] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.985617] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.985617] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.985617] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.985617] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.985617] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.985617] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.985617] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.985617] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.985617] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab9efec0-c13a-4960-afb7-a800c8e897d8 already deleted. [ 614.985617] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab9efec0-c13a-4960-afb7-a800c8e897d8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.302902] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e02be8c7-70b1-4488-b079-b1ebf20a733c taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.303091] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.303170] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.303391] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.303560] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.303654] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.303917] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.303917] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.304023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.304055] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.304200] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e02be8c7-70b1-4488-b079-b1ebf20a733c taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.304289] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.304345] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.304512] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.304652] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.304742] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.304799] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.305054] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.305054] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.305155] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.305245] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.387152] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 634e6dfa-30e0-4408-beda-a5ebd13f7971 [ 615.387152] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.387560] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.387560] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.387560] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.387654] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.387732] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:634e6dfa-30e0-4408-beda-a5ebd13f7971 already deleted. [ 615.387812] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-634e6dfa-30e0-4408-beda-a5ebd13f7971" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.440738] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.440922] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.441056] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.441350] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.441492] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.441636] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port 66c24191-101c-4ff5-b083-c2c9d4b7be4d not found, creating... [ 615.441928] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.442048] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.442227] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.442544] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.442743] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.443515] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.443691] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.443809] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.444041] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.444180] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.444331] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: 66c24191-101c-4ff5-b083-c2c9d4b7be4d is going to be created. [ 615.464182] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.464421] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.464512] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.464771] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.465057] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.465336] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-66c24191-101c-4ff5-b083-c2c9d4b7be4d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.598027] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf5449c8-e110-49bf-b5ea-dcfeefaf5d48 in Status: SUCCESS [ 615.598027] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.808351] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e02be8c7-70b1-4488-b079-b1ebf20a733c: rpc.has_security_group_logging(os_id): False [ 615.828433] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.828592] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.828653] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.828872] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.828960] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.829200] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.829299] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.829359] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.829503] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.829579] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.829747] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.829837] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.829897] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.830045] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.830117] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.830306] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.830395] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.830455] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.830592] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.830663] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.830743] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e02be8c7-70b1-4488-b079-b1ebf20a733c is going to be created. [ 615.892959] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.893205] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.893280] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.893480] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.893651] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.903810] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e02be8c7-70b1-4488-b079-b1ebf20a733c in Status: IN_PROGRESS for 2s [ 616.223101] env[65943]: INFO networking_nsxv3.common.synchronization [req-2c7c4cb8-ffec-4f50-b52e-ec7df958b5e4 req-79e01143-d93e-4702-a041-188362eb771e service nova] Enqueued Resource ID: ab9efec0-c13a-4960-afb7-a800c8e897d8 with Priority: HIGHEST for action security_group_rules [ 616.223282] env[65943]: INFO networking_nsxv3.common.synchronization [req-2c7c4cb8-ffec-4f50-b52e-ec7df958b5e4 req-79e01143-d93e-4702-a041-188362eb771e service nova] Enqueued Resource ID: ab9efec0-c13a-4960-afb7-a800c8e897d8 with Priority: HIGHEST for action security_group_members [ 616.223411] env[65943]: INFO networking_nsxv3.common.synchronization [req-2c7c4cb8-ffec-4f50-b52e-ec7df958b5e4 req-79e01143-d93e-4702-a041-188362eb771e service nova] Enqueued Resource ID: 66c24191-101c-4ff5-b083-c2c9d4b7be4d with Priority: HIGHEST for action port [ 616.223639] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab9efec0-c13a-4960-afb7-a800c8e897d8 with Priority: HIGHEST for action security_group_rules [ 616.223769] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab9efec0-c13a-4960-afb7-a800c8e897d8 with Priority: HIGHEST for action security_group_members [ 616.223867] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66c24191-101c-4ff5-b083-c2c9d4b7be4d with Priority: HIGHEST for action port [ 616.224458] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab9efec0-c13a-4960-afb7-a800c8e897d8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.224919] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab9efec0-c13a-4960-afb7-a800c8e897d8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.224919] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab9efec0-c13a-4960-afb7-a800c8e897d8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.224919] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab9efec0-c13a-4960-afb7-a800c8e897d8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.224919] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab9efec0-c13a-4960-afb7-a800c8e897d8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.227611] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab9efec0-c13a-4960-afb7-a800c8e897d8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.227611] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab9efec0-c13a-4960-afb7-a800c8e897d8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.227611] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab9efec0-c13a-4960-afb7-a800c8e897d8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.227835] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab9efec0-c13a-4960-afb7-a800c8e897d8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.227871] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.227961] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.228046] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.228208] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.228295] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.228388] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab9efec0-c13a-4960-afb7-a800c8e897d8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.229782] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-66c24191-101c-4ff5-b083-c2c9d4b7be4d taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.229949] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66c24191-101c-4ff5-b083-c2c9d4b7be4d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.229949] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66c24191-101c-4ff5-b083-c2c9d4b7be4d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.230130] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66c24191-101c-4ff5-b083-c2c9d4b7be4d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.230243] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66c24191-101c-4ff5-b083-c2c9d4b7be4d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.480672] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e550f237-9e27-45ea-9e02-516ac8d2852f in Status: SUCCESS [ 616.480672] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e550f237-9e27-45ea-9e02-516ac8d2852f deletion is rescheduled due to dependency. [ 616.480672] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.732530] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab9efec0-c13a-4960-afb7-a800c8e897d8 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.732667] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab9efec0-c13a-4960-afb7-a800c8e897d8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.732869] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab9efec0-c13a-4960-afb7-a800c8e897d8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.733778] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 66c24191-101c-4ff5-b083-c2c9d4b7be4d with status ACTIVE [ 616.733968] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.734101] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.734169] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.734373] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.734463] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.734626] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.734723] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.734801] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.734989] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.735106] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.736283] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.736283] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.736283] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.736283] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.736283] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.736283] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 66c24191-101c-4ff5-b083-c2c9d4b7be4d is going to be updated. [ 616.766885] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.766885] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.766885] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.767156] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.767156] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.767426] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66c24191-101c-4ff5-b083-c2c9d4b7be4d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.886857] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d0b6f8c-385a-4740-8634-e522537eba0d in Status: SUCCESS [ 616.887136] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d0b6f8c-385a-4740-8634-e522537eba0d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.887656] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d0b6f8c-385a-4740-8634-e522537eba0d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.887874] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d0b6f8c-385a-4740-8634-e522537eba0d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.888093] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.888208] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.888274] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.888742] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.888742] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.888742] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d0b6f8c-385a-4740-8634-e522537eba0d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.888742] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4d0b6f8c-385a-4740-8634-e522537eba0d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.238149] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab9efec0-c13a-4960-afb7-a800c8e897d8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.331045] env[65943]: INFO networking_nsxv3.common.synchronization [None req-49b66aa8-a6af-44ce-b952-9baddab76ff1 None None] Enqueued Resource ID: 2cc38477-0c0c-4a42-890f-8abe676e2b4c with Priority: HIGHEST for action port [ 617.332239] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cc38477-0c0c-4a42-890f-8abe676e2b4c with Priority: HIGHEST for action port [ 617.332462] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-2cc38477-0c0c-4a42-890f-8abe676e2b4c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.332661] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2cc38477-0c0c-4a42-890f-8abe676e2b4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.332758] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2cc38477-0c0c-4a42-890f-8abe676e2b4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.333194] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2cc38477-0c0c-4a42-890f-8abe676e2b4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.333426] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cc38477-0c0c-4a42-890f-8abe676e2b4c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.393144] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d0b6f8c-385a-4740-8634-e522537eba0d taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.393442] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d0b6f8c-385a-4740-8634-e522537eba0d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.393716] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d0b6f8c-385a-4740-8634-e522537eba0d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.394055] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d0b6f8c-385a-4740-8634-e522537eba0d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.394294] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.394426] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.394586] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.394801] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.394926] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.395092] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d0b6f8c-385a-4740-8634-e522537eba0d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.395299] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d0b6f8c-385a-4740-8634-e522537eba0d taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.395432] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d0b6f8c-385a-4740-8634-e522537eba0d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.395517] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d0b6f8c-385a-4740-8634-e522537eba0d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.395696] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d0b6f8c-385a-4740-8634-e522537eba0d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.395876] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.396096] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.396154] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.396323] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.396422] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.397034] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d0b6f8c-385a-4740-8634-e522537eba0d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.397034] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4d0b6f8c-385a-4740-8634-e522537eba0d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.742414] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.742414] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.742726] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.742726] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.742790] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.742924] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab9efec0-c13a-4960-afb7-a800c8e897d8 is going to be created. [ 617.772847] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.773107] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.773107] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.773471] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.773580] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.784973] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab9efec0-c13a-4960-afb7-a800c8e897d8 in Status: UNINITIALIZED for 2s [ 617.836422] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2cc38477-0c0c-4a42-890f-8abe676e2b4c [ 617.836666] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.836825] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.836968] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.837104] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.837197] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.837292] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2cc38477-0c0c-4a42-890f-8abe676e2b4c already deleted. [ 617.837393] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2cc38477-0c0c-4a42-890f-8abe676e2b4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.900471] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4d0b6f8c-385a-4740-8634-e522537eba0d: rpc.has_security_group_logging(os_id): False [ 617.918113] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e02be8c7-70b1-4488-b079-b1ebf20a733c in Status: SUCCESS [ 617.918113] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.923497] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.923497] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.923497] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.923497] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.923497] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.923497] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.923497] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.923497] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.923497] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.923497] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.924229] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.924229] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.924229] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.924229] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.924381] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.928030] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.928030] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.928030] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.928030] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.928030] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.928030] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d0b6f8c-385a-4740-8634-e522537eba0d is going to be created. [ 617.995351] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.995563] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.995610] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.995849] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.996071] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.015238] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4d0b6f8c-385a-4740-8634-e522537eba0d in Status: IN_PROGRESS for 2s [ 618.963258] env[65943]: INFO networking_nsxv3.common.synchronization [req-3d425148-da73-4b9f-8479-8bc6d382e14b req-6b78d106-bae3-4e22-9419-223a1908afff tempest-ServersAdminTestJSON-910281195 tempest-ServersAdminTestJSON-910281195-project-member] Enqueued Resource ID: e02be8c7-70b1-4488-b079-b1ebf20a733c with Priority: HIGHEST for action security_group_members [ 618.963771] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e02be8c7-70b1-4488-b079-b1ebf20a733c with Priority: HIGHEST for action security_group_members [ 618.964127] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e02be8c7-70b1-4488-b079-b1ebf20a733c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.964292] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.964372] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.964563] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.964747] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.964853] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.964963] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.965100] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.965216] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.965327] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.469098] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.643913] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-581 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.644167] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-581" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.644384] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-581" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.644771] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-581" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.645164] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.645455] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.645660] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.646144] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.646366] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.646616] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 619.646733] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 619.646838] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 619.646941] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 619.647060] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 619.647162] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 619.647299] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 619.669630] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 619.669857] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 619.670048] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 619.671049] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-581" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.671049] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-45768e4e-6ff2-4a10-8de3-0ee892aef0a3 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.671049] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-45768e4e-6ff2-4a10-8de3-0ee892aef0a3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.671220] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-45768e4e-6ff2-4a10-8de3-0ee892aef0a3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.671562] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-45768e4e-6ff2-4a10-8de3-0ee892aef0a3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.671774] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45768e4e-6ff2-4a10-8de3-0ee892aef0a3',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.798369] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab9efec0-c13a-4960-afb7-a800c8e897d8 in Status: SUCCESS [ 619.798620] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab9efec0-c13a-4960-afb7-a800c8e897d8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.798756] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab9efec0-c13a-4960-afb7-a800c8e897d8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.799078] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab9efec0-c13a-4960-afb7-a800c8e897d8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.799528] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.799528] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.799730] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.799796] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.799901] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.799992] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab9efec0-c13a-4960-afb7-a800c8e897d8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.800102] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab9efec0-c13a-4960-afb7-a800c8e897d8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.971243] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.033933] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4d0b6f8c-385a-4740-8634-e522537eba0d in Status: SUCCESS [ 620.034189] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d0b6f8c-385a-4740-8634-e522537eba0d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.174965] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.175296] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.175879] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.175879] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.175879] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.176196] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port 45768e4e-6ff2-4a10-8de3-0ee892aef0a3 not found, creating... [ 620.176324] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.176512] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.176655] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.176843] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.177031] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.177440] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.177691] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.177798] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.178075] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.178223] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.178395] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: 45768e4e-6ff2-4a10-8de3-0ee892aef0a3 is going to be created. [ 620.200099] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.200364] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.200487] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.200766] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.201026] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.201463] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-45768e4e-6ff2-4a10-8de3-0ee892aef0a3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.303129] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab9efec0-c13a-4960-afb7-a800c8e897d8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.476869] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.476869] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.476869] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.476869] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.476869] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.476869] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e02be8c7-70b1-4488-b079-b1ebf20a733c is going to be updated. [ 620.511133] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.511133] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.511133] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.511133] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.511577] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.523994] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e02be8c7-70b1-4488-b079-b1ebf20a733c in Status: IN_PROGRESS for 2s [ 620.808105] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab9efec0-c13a-4960-afb7-a800c8e897d8: rpc.has_security_group_logging(os_id): False [ 620.828533] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.828722] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.828855] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.828969] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.829071] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.829345] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.830145] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.830145] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.830145] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.830145] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.830145] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab9efec0-c13a-4960-afb7-a800c8e897d8 is going to be created. [ 620.891530] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.891686] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.891812] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.892479] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.892821] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.908021] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab9efec0-c13a-4960-afb7-a800c8e897d8 in Status: IN_PROGRESS for 2s [ 620.978996] env[65943]: INFO networking_nsxv3.common.synchronization [req-3d425148-da73-4b9f-8479-8bc6d382e14b req-180ce22a-5c73-4950-ac93-ebd8a01ec03b service nova] Enqueued Resource ID: e02be8c7-70b1-4488-b079-b1ebf20a733c with Priority: HIGHEST for action security_group_rules [ 620.979441] env[65943]: INFO networking_nsxv3.common.synchronization [req-3d425148-da73-4b9f-8479-8bc6d382e14b req-180ce22a-5c73-4950-ac93-ebd8a01ec03b service nova] Enqueued Resource ID: e02be8c7-70b1-4488-b079-b1ebf20a733c with Priority: HIGHEST for action security_group_members [ 620.979441] env[65943]: INFO networking_nsxv3.common.synchronization [req-3d425148-da73-4b9f-8479-8bc6d382e14b req-180ce22a-5c73-4950-ac93-ebd8a01ec03b service nova] Enqueued Resource ID: 45768e4e-6ff2-4a10-8de3-0ee892aef0a3 with Priority: HIGHEST for action port [ 620.980073] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e02be8c7-70b1-4488-b079-b1ebf20a733c with Priority: HIGHEST for action security_group_rules [ 620.980143] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e02be8c7-70b1-4488-b079-b1ebf20a733c with Priority: HIGHEST for action security_group_members [ 620.980288] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45768e4e-6ff2-4a10-8de3-0ee892aef0a3 with Priority: HIGHEST for action port [ 620.980683] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e02be8c7-70b1-4488-b079-b1ebf20a733c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.980892] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.981031] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.981760] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.981760] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.983322] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e02be8c7-70b1-4488-b079-b1ebf20a733c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.983441] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.984809] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-45768e4e-6ff2-4a10-8de3-0ee892aef0a3 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.984809] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45768e4e-6ff2-4a10-8de3-0ee892aef0a3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.984809] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45768e4e-6ff2-4a10-8de3-0ee892aef0a3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.984809] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45768e4e-6ff2-4a10-8de3-0ee892aef0a3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.984809] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45768e4e-6ff2-4a10-8de3-0ee892aef0a3',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.048268] env[65943]: INFO networking_nsxv3.common.synchronization [None req-47cb16f3-118d-46aa-94ce-635502a6dff3 tempest-ServersWithSpecificFlavorTestJSON-110328110 tempest-ServersWithSpecificFlavorTestJSON-110328110-project-member] Enqueued Resource ID: b88e0956-a799-4c5e-8e71-323151811fd1 with Priority: HIGHEST for action security_group_rules [ 621.048268] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b88e0956-a799-4c5e-8e71-323151811fd1 with Priority: HIGHEST for action security_group_rules [ 621.048268] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b88e0956-a799-4c5e-8e71-323151811fd1 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.048268] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.048268] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.048268] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.048268] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b88e0956-a799-4c5e-8e71-323151811fd1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.307116] env[65943]: INFO networking_nsxv3.common.synchronization [None req-4c7dc1c7-51d0-4faa-890b-d3b0134f26aa tempest-ServersWithSpecificFlavorTestJSON-110328110 tempest-ServersWithSpecificFlavorTestJSON-110328110-project-member] Enqueued Resource ID: b88e0956-a799-4c5e-8e71-323151811fd1 with Priority: HIGHEST for action security_group_rules [ 621.307790] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b88e0956-a799-4c5e-8e71-323151811fd1 with Priority: HIGHEST for action security_group_rules [ 621.308822] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b88e0956-a799-4c5e-8e71-323151811fd1 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.308822] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.439701] env[65943]: INFO networking_nsxv3.common.synchronization [req-9537b7be-092e-4431-bc0e-06552940082d req-afa5ad66-369e-49aa-84d8-2d3c2467da21 tempest-ServerDiagnosticsNegativeTest-953639815 tempest-ServerDiagnosticsNegativeTest-953639815-project-member] Enqueued Resource ID: fec81ce3-7d2a-43a6-b4de-83696a200925 with Priority: HIGHEST for action security_group_members [ 621.440289] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fec81ce3-7d2a-43a6-b4de-83696a200925 with Priority: HIGHEST for action security_group_members [ 621.446022] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-fec81ce3-7d2a-43a6-b4de-83696a200925 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.446022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fec81ce3-7d2a-43a6-b4de-83696a200925" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.446022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fec81ce3-7d2a-43a6-b4de-83696a200925" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.446022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fec81ce3-7d2a-43a6-b4de-83696a200925" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.446022] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.446022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.446022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.446022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.446022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.446022] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fec81ce3-7d2a-43a6-b4de-83696a200925',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.487120] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e02be8c7-70b1-4488-b079-b1ebf20a733c taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.487120] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.487120] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 45768e4e-6ff2-4a10-8de3-0ee892aef0a3 with status ACTIVE [ 621.487472] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.488041] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.488041] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.488041] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.488041] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.488285] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.488338] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.488373] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.488680] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.488680] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.489370] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.489370] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.489370] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.489370] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.489370] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.489979] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 45768e4e-6ff2-4a10-8de3-0ee892aef0a3 is going to be updated. [ 621.515221] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.515314] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.516846] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.516846] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.516846] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.516846] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45768e4e-6ff2-4a10-8de3-0ee892aef0a3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.573647] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.573647] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.573647] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.573851] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.574016] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.574052] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b88e0956-a799-4c5e-8e71-323151811fd1 already deleted. [ 621.574114] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.576920] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.576920] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.576920] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b88e0956-a799-4c5e-8e71-323151811fd1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.779960] env[65943]: INFO networking_nsxv3.common.synchronization [req-e1218f59-da13-48d1-a559-6f918105353c req-ae136187-55c0-4a81-b438-c7fb380e6fc9 tempest-VolumesAssistedSnapshotsTest-1092122238 tempest-VolumesAssistedSnapshotsTest-1092122238-project-member] Enqueued Resource ID: d97ff6f8-41cc-4974-82fe-bda7247ceb2b with Priority: HIGHEST for action security_group_members [ 621.779960] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d97ff6f8-41cc-4974-82fe-bda7247ceb2b with Priority: HIGHEST for action security_group_members [ 621.779960] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-d97ff6f8-41cc-4974-82fe-bda7247ceb2b taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.779960] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d97ff6f8-41cc-4974-82fe-bda7247ceb2b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.779960] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d97ff6f8-41cc-4974-82fe-bda7247ceb2b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.779960] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d97ff6f8-41cc-4974-82fe-bda7247ceb2b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.779960] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.779960] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.779960] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.781986] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.782236] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.782517] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d97ff6f8-41cc-4974-82fe-bda7247ceb2b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.947632] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.947793] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.947867] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.948108] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.948206] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.948398] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.948495] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.948555] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.948704] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.948779] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.948867] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fec81ce3-7d2a-43a6-b4de-83696a200925 is going to be updated. [ 621.975747] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.975938] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.975938] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.976207] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.976335] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.985166] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fec81ce3-7d2a-43a6-b4de-83696a200925 in Status: IN_PROGRESS for 2s [ 622.101977] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.102402] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.102402] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.102522] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.102569] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.103246] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b88e0956-a799-4c5e-8e71-323151811fd1 already deleted. [ 622.103246] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.157312] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-168 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.157504] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-168" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.157619] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-168" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.157980] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-168" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.158269] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.158482] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.158624] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.158864] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.159065] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.159292] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 622.159403] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 622.159511] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 622.159613] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 622.159719] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 622.159820] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 622.159948] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 622.180956] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 622.181890] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 622.181890] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 622.181890] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-168" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.182130] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-1aeb1c35-7110-4c2f-890c-6c21f6386b80 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.182390] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-1aeb1c35-7110-4c2f-890c-6c21f6386b80" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.182538] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-1aeb1c35-7110-4c2f-890c-6c21f6386b80" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.183269] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-1aeb1c35-7110-4c2f-890c-6c21f6386b80" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.183269] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1aeb1c35-7110-4c2f-890c-6c21f6386b80',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.287800] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.287986] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.287986] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.288190] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.288262] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.288474] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.288706] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.288706] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.288856] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.288904] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.288950] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d97ff6f8-41cc-4974-82fe-bda7247ceb2b already deleted. [ 622.289040] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d97ff6f8-41cc-4974-82fe-bda7247ceb2b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.535290] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e02be8c7-70b1-4488-b079-b1ebf20a733c in Status: SUCCESS [ 622.535506] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.536254] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.536254] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.536254] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.536254] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.536254] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.536676] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.536676] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.536676] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.686033] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.686342] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.686437] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.686897] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.687167] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.687431] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port 1aeb1c35-7110-4c2f-890c-6c21f6386b80 not found, creating... [ 622.687912] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.688479] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.688686] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.689226] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.689373] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.689762] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.689943] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.690076] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.690334] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.690498] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.690687] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: 1aeb1c35-7110-4c2f-890c-6c21f6386b80 is going to be created. [ 622.720027] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.720264] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.720264] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.721107] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.721497] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.721773] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-1aeb1c35-7110-4c2f-890c-6c21f6386b80" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.926288] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab9efec0-c13a-4960-afb7-a800c8e897d8 in Status: SUCCESS [ 622.926624] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab9efec0-c13a-4960-afb7-a800c8e897d8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.039612] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.451120] env[65943]: INFO networking_nsxv3.common.synchronization [req-e1218f59-da13-48d1-a559-6f918105353c req-26e1456d-75af-49e9-91da-7ae5ca6788a1 service nova] Enqueued Resource ID: d97ff6f8-41cc-4974-82fe-bda7247ceb2b with Priority: HIGHEST for action security_group_rules [ 623.451293] env[65943]: INFO networking_nsxv3.common.synchronization [req-e1218f59-da13-48d1-a559-6f918105353c req-26e1456d-75af-49e9-91da-7ae5ca6788a1 service nova] Enqueued Resource ID: d97ff6f8-41cc-4974-82fe-bda7247ceb2b with Priority: HIGHEST for action security_group_members [ 623.451420] env[65943]: INFO networking_nsxv3.common.synchronization [req-e1218f59-da13-48d1-a559-6f918105353c req-26e1456d-75af-49e9-91da-7ae5ca6788a1 service nova] Enqueued Resource ID: 1aeb1c35-7110-4c2f-890c-6c21f6386b80 with Priority: HIGHEST for action port [ 623.451934] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d97ff6f8-41cc-4974-82fe-bda7247ceb2b with Priority: HIGHEST for action security_group_rules [ 623.452105] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d97ff6f8-41cc-4974-82fe-bda7247ceb2b with Priority: HIGHEST for action security_group_members [ 623.452205] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1aeb1c35-7110-4c2f-890c-6c21f6386b80 with Priority: HIGHEST for action port [ 623.452504] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d97ff6f8-41cc-4974-82fe-bda7247ceb2b taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.452624] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d97ff6f8-41cc-4974-82fe-bda7247ceb2b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.452728] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d97ff6f8-41cc-4974-82fe-bda7247ceb2b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.452895] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d97ff6f8-41cc-4974-82fe-bda7247ceb2b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.452961] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d97ff6f8-41cc-4974-82fe-bda7247ceb2b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.455186] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-d97ff6f8-41cc-4974-82fe-bda7247ceb2b taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.455524] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d97ff6f8-41cc-4974-82fe-bda7247ceb2b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.455645] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d97ff6f8-41cc-4974-82fe-bda7247ceb2b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.457232] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d97ff6f8-41cc-4974-82fe-bda7247ceb2b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.457232] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.457232] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.457232] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.458494] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.458494] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.458494] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d97ff6f8-41cc-4974-82fe-bda7247ceb2b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.458825] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-1aeb1c35-7110-4c2f-890c-6c21f6386b80 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.459224] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1aeb1c35-7110-4c2f-890c-6c21f6386b80" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.459224] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1aeb1c35-7110-4c2f-890c-6c21f6386b80" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.460222] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1aeb1c35-7110-4c2f-890c-6c21f6386b80" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.461169] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1aeb1c35-7110-4c2f-890c-6c21f6386b80',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.542624] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.826814] env[65943]: INFO networking_nsxv3.common.synchronization [req-d950b1ce-5905-4e5b-8599-0fc313178a4c req-261da18f-988a-426e-8d3c-bd6efe25e5a8 tempest-ServersTestJSON-1580779679 tempest-ServersTestJSON-1580779679-project-member] Enqueued Resource ID: dcee84a2-5f8e-4aff-856c-81b817d31434 with Priority: HIGHEST for action security_group_members [ 623.827429] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcee84a2-5f8e-4aff-856c-81b817d31434 with Priority: HIGHEST for action security_group_members [ 623.827762] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcee84a2-5f8e-4aff-856c-81b817d31434 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.827893] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcee84a2-5f8e-4aff-856c-81b817d31434" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.827963] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcee84a2-5f8e-4aff-856c-81b817d31434" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.828427] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcee84a2-5f8e-4aff-856c-81b817d31434" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.828603] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.828711] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.828774] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.828944] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.829048] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.829153] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dcee84a2-5f8e-4aff-856c-81b817d31434',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.963830] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-d97ff6f8-41cc-4974-82fe-bda7247ceb2b taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.963830] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d97ff6f8-41cc-4974-82fe-bda7247ceb2b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.963830] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d97ff6f8-41cc-4974-82fe-bda7247ceb2b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.964590] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1aeb1c35-7110-4c2f-890c-6c21f6386b80 with status ACTIVE [ 623.964975] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.964975] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.964975] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.965843] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.965843] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.965843] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.965843] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.965843] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.965843] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.966449] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.966752] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.966895] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.967027] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.967273] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.967705] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.967705] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1aeb1c35-7110-4c2f-890c-6c21f6386b80 is going to be updated. [ 623.992020] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.992020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.992020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.992020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.992020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.992020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1aeb1c35-7110-4c2f-890c-6c21f6386b80" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.994924] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fec81ce3-7d2a-43a6-b4de-83696a200925 in Status: SUCCESS [ 623.995164] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fec81ce3-7d2a-43a6-b4de-83696a200925 deletion is rescheduled due to dependency. [ 623.995279] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fec81ce3-7d2a-43a6-b4de-83696a200925" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.045952] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.045952] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.046407] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.046407] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.046505] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.046549] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e02be8c7-70b1-4488-b079-b1ebf20a733c is going to be updated. [ 624.116436] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.119103] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.119350] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.123820] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.124027] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.140414] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e02be8c7-70b1-4488-b079-b1ebf20a733c in Status: IN_PROGRESS for 2s [ 624.294691] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-995 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.294901] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-995" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.295328] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-995" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.295518] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-995" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.295816] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.295977] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.296159] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.296390] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.296533] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.296758] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 624.296866] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 624.296967] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 624.297082] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 624.297209] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 624.297313] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 624.297435] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 624.318716] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 624.318716] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 624.318716] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 624.318716] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-995" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.319221] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-1a421343-446f-4f77-8f28-35bc976c42e1 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.319221] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-1a421343-446f-4f77-8f28-35bc976c42e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.319384] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-1a421343-446f-4f77-8f28-35bc976c42e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.319633] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-1a421343-446f-4f77-8f28-35bc976c42e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.319776] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a421343-446f-4f77-8f28-35bc976c42e1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.333070] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.333070] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.333070] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.333070] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.333574] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.334502] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.334502] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.334502] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.334502] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.334502] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.334502] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcee84a2-5f8e-4aff-856c-81b817d31434 already deleted. [ 624.334502] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcee84a2-5f8e-4aff-856c-81b817d31434" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.471029] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d97ff6f8-41cc-4974-82fe-bda7247ceb2b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.822559] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.822760] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.822898] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.823520] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.823520] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.823520] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port 1a421343-446f-4f77-8f28-35bc976c42e1 not found, creating... [ 624.825364] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.825546] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.825664] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.825909] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.826057] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.826374] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.826532] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.826642] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.826873] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.827011] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.827978] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: 1a421343-446f-4f77-8f28-35bc976c42e1 is going to be created. [ 624.853302] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.853302] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.853302] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.853302] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.853302] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.853302] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-1a421343-446f-4f77-8f28-35bc976c42e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.972176] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.972403] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.972447] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.972739] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.972795] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.972903] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d97ff6f8-41cc-4974-82fe-bda7247ceb2b is going to be created. [ 624.999751] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.999964] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.999964] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.000189] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.000351] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.021061] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d97ff6f8-41cc-4974-82fe-bda7247ceb2b in Status: UNINITIALIZED for 2s [ 625.591330] env[65943]: INFO networking_nsxv3.common.synchronization [req-d950b1ce-5905-4e5b-8599-0fc313178a4c req-502b3444-3d6b-4e53-b6f6-77dfc82e71e4 service nova] Enqueued Resource ID: dcee84a2-5f8e-4aff-856c-81b817d31434 with Priority: HIGHEST for action security_group_rules [ 625.591330] env[65943]: INFO networking_nsxv3.common.synchronization [req-d950b1ce-5905-4e5b-8599-0fc313178a4c req-502b3444-3d6b-4e53-b6f6-77dfc82e71e4 service nova] Enqueued Resource ID: dcee84a2-5f8e-4aff-856c-81b817d31434 with Priority: HIGHEST for action security_group_members [ 625.591330] env[65943]: INFO networking_nsxv3.common.synchronization [req-d950b1ce-5905-4e5b-8599-0fc313178a4c req-502b3444-3d6b-4e53-b6f6-77dfc82e71e4 service nova] Enqueued Resource ID: 1a421343-446f-4f77-8f28-35bc976c42e1 with Priority: HIGHEST for action port [ 625.591330] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcee84a2-5f8e-4aff-856c-81b817d31434 with Priority: HIGHEST for action security_group_rules [ 625.591330] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcee84a2-5f8e-4aff-856c-81b817d31434 with Priority: HIGHEST for action security_group_members [ 625.591330] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a421343-446f-4f77-8f28-35bc976c42e1 with Priority: HIGHEST for action port [ 625.591330] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dcee84a2-5f8e-4aff-856c-81b817d31434 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.591330] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dcee84a2-5f8e-4aff-856c-81b817d31434" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.591330] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dcee84a2-5f8e-4aff-856c-81b817d31434" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.592714] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dcee84a2-5f8e-4aff-856c-81b817d31434" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.593095] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dcee84a2-5f8e-4aff-856c-81b817d31434',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.598264] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcee84a2-5f8e-4aff-856c-81b817d31434 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.598264] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcee84a2-5f8e-4aff-856c-81b817d31434" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.598264] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcee84a2-5f8e-4aff-856c-81b817d31434" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.598264] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcee84a2-5f8e-4aff-856c-81b817d31434" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.598264] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.598264] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.598264] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.598264] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.598264] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.598264] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dcee84a2-5f8e-4aff-856c-81b817d31434',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.600092] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a421343-446f-4f77-8f28-35bc976c42e1 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.601842] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a421343-446f-4f77-8f28-35bc976c42e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.601842] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a421343-446f-4f77-8f28-35bc976c42e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.601842] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a421343-446f-4f77-8f28-35bc976c42e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.601842] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a421343-446f-4f77-8f28-35bc976c42e1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.103147] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcee84a2-5f8e-4aff-856c-81b817d31434 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.103612] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcee84a2-5f8e-4aff-856c-81b817d31434" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.103612] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dcee84a2-5f8e-4aff-856c-81b817d31434',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.105299] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a421343-446f-4f77-8f28-35bc976c42e1 with status ACTIVE [ 626.106730] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.106730] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.106730] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.106730] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.106730] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.106730] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.106730] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.106730] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.106730] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.106730] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.107188] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.107188] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.107188] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.107369] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.107369] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.107440] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a421343-446f-4f77-8f28-35bc976c42e1 is going to be updated. [ 626.136060] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.136060] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.136060] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.136060] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.136060] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.136060] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a421343-446f-4f77-8f28-35bc976c42e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.158823] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e02be8c7-70b1-4488-b079-b1ebf20a733c in Status: SUCCESS [ 626.159412] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.159711] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.159777] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.160083] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.160274] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.160368] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.160605] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.160728] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.161068] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.161068] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.280029] env[65943]: INFO networking_nsxv3.common.synchronization [req-64c6427a-4648-4973-9f8f-0477afb17c2b req-29e1a693-0297-46db-93c8-fce8aa8ebff3 tempest-ServerActionsTestJSON-1587559204 tempest-ServerActionsTestJSON-1587559204-project-member] Enqueued Resource ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 with Priority: HIGHEST for action security_group_members [ 626.280558] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 with Priority: HIGHEST for action security_group_members [ 626.281429] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bcdadce-edf2-43d0-a8d9-43033bb27e63 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.281429] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.281429] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.281429] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.281700] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.281700] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.281700] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.281816] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.281848] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.283013] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bcdadce-edf2-43d0-a8d9-43033bb27e63',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.606811] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dcee84a2-5f8e-4aff-856c-81b817d31434',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.653171] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-287 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.653433] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-287" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.653558] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-287" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.654143] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-287" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.654265] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.655782] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.657936] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.657936] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.657936] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.657936] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 626.657936] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 626.657936] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 626.657936] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 626.659224] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 626.659343] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 626.659577] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 626.664246] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e02be8c7-70b1-4488-b079-b1ebf20a733c taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.664401] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.664468] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.664754] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.664968] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.665062] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.665062] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.666082] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.666082] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.666082] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.666082] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e02be8c7-70b1-4488-b079-b1ebf20a733c taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.666082] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.666082] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.666082] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.666082] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.666082] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.666596] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.666596] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.666596] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.666596] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.666596] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.681422] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 626.681683] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 626.681867] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 626.682064] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-287" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.682369] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-0e60f38e-5c85-42a7-9b6a-39cb4cd8dc68 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.682545] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-0e60f38e-5c85-42a7-9b6a-39cb4cd8dc68" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.682659] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-0e60f38e-5c85-42a7-9b6a-39cb4cd8dc68" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.682955] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-0e60f38e-5c85-42a7-9b6a-39cb4cd8dc68" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.683641] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e60f38e-5c85-42a7-9b6a-39cb4cd8dc68',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.785776] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.785970] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.786066] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.786242] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.786339] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.786539] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.786628] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.786692] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.786912] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.786912] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.787015] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 already deleted. [ 626.787146] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.032875] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d97ff6f8-41cc-4974-82fe-bda7247ceb2b in Status: SUCCESS [ 627.033156] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d97ff6f8-41cc-4974-82fe-bda7247ceb2b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.033380] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d97ff6f8-41cc-4974-82fe-bda7247ceb2b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.033613] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d97ff6f8-41cc-4974-82fe-bda7247ceb2b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.033809] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.033947] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.034030] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.034214] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.034303] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.034435] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d97ff6f8-41cc-4974-82fe-bda7247ceb2b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.034512] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d97ff6f8-41cc-4974-82fe-bda7247ceb2b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.110211] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.110509] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.111333] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.111658] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.111823] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.111987] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcee84a2-5f8e-4aff-856c-81b817d31434 is going to be created. [ 627.144936] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.145088] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.145218] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.145446] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.145712] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.157812] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcee84a2-5f8e-4aff-856c-81b817d31434 in Status: UNINITIALIZED for 2s [ 627.169588] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e02be8c7-70b1-4488-b079-b1ebf20a733c: rpc.has_security_group_logging(os_id): False [ 627.186279] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.186934] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.187952] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.188402] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.188686] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.188993] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port 0e60f38e-5c85-42a7-9b6a-39cb4cd8dc68 not found, creating... [ 627.189520] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.190484] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.190484] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.190484] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.190484] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.190739] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.190894] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.191032] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.191456] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.191456] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.191597] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: 0e60f38e-5c85-42a7-9b6a-39cb4cd8dc68 is going to be created. [ 627.193522] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.193709] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.193823] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.194061] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.194061] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.194289] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.194419] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.194506] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.194672] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.194776] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.194997] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.195179] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.195262] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.195402] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.195475] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.196217] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.196217] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.196217] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.196217] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.196217] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.196466] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e02be8c7-70b1-4488-b079-b1ebf20a733c is going to be updated. [ 627.224181] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.224274] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.224348] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.225791] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.225791] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.225791] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-0e60f38e-5c85-42a7-9b6a-39cb4cd8dc68" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.273466] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.273466] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.273466] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.273466] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.273466] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.293225] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e02be8c7-70b1-4488-b079-b1ebf20a733c in Status: IN_PROGRESS for 2s [ 627.537460] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d97ff6f8-41cc-4974-82fe-bda7247ceb2b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.972295] env[65943]: INFO networking_nsxv3.common.synchronization [req-64c6427a-4648-4973-9f8f-0477afb17c2b req-2077607e-88a6-4b7e-9094-471f398f729d service nova] Enqueued Resource ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 with Priority: HIGHEST for action security_group_rules [ 627.972295] env[65943]: INFO networking_nsxv3.common.synchronization [req-64c6427a-4648-4973-9f8f-0477afb17c2b req-2077607e-88a6-4b7e-9094-471f398f729d service nova] Enqueued Resource ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 with Priority: HIGHEST for action security_group_members [ 627.972295] env[65943]: INFO networking_nsxv3.common.synchronization [req-64c6427a-4648-4973-9f8f-0477afb17c2b req-2077607e-88a6-4b7e-9094-471f398f729d service nova] Enqueued Resource ID: 0e60f38e-5c85-42a7-9b6a-39cb4cd8dc68 with Priority: HIGHEST for action port [ 627.972295] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 with Priority: HIGHEST for action security_group_rules [ 627.972767] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 with Priority: HIGHEST for action security_group_members [ 627.972767] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e60f38e-5c85-42a7-9b6a-39cb4cd8dc68 with Priority: HIGHEST for action port [ 627.975437] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.975604] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.975660] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.975911] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.975978] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7bcdadce-edf2-43d0-a8d9-43033bb27e63',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.976925] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bcdadce-edf2-43d0-a8d9-43033bb27e63 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.977020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.977088] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.977250] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.977811] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.977811] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.977811] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.977811] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.977811] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.977980] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bcdadce-edf2-43d0-a8d9-43033bb27e63',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.979103] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e60f38e-5c85-42a7-9b6a-39cb4cd8dc68 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.979103] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e60f38e-5c85-42a7-9b6a-39cb4cd8dc68" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.979103] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e60f38e-5c85-42a7-9b6a-39cb4cd8dc68" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.979103] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e60f38e-5c85-42a7-9b6a-39cb4cd8dc68" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.979387] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e60f38e-5c85-42a7-9b6a-39cb4cd8dc68',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.039629] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d97ff6f8-41cc-4974-82fe-bda7247ceb2b: rpc.has_security_group_logging(os_id): False [ 628.065436] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.065731] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.065987] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.066234] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.066375] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.066745] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.067096] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.067096] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.067289] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.067289] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.067464] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d97ff6f8-41cc-4974-82fe-bda7247ceb2b is going to be created. [ 628.151565] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.151787] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.151877] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.152194] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.152466] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.165573] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d97ff6f8-41cc-4974-82fe-bda7247ceb2b in Status: IN_PROGRESS for 2s [ 628.481554] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7bcdadce-edf2-43d0-a8d9-43033bb27e63',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.487184] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bcdadce-edf2-43d0-a8d9-43033bb27e63 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.487184] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.487184] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0e60f38e-5c85-42a7-9b6a-39cb4cd8dc68 with status ACTIVE [ 628.487184] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.487184] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.487184] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.487184] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.487184] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.487184] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.487184] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.487184] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.487736] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.487736] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.487950] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.487950] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.488076] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.488199] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.488382] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.489886] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0e60f38e-5c85-42a7-9b6a-39cb4cd8dc68 is going to be updated. [ 628.519487] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.519635] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.519703] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.519914] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.520064] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.520224] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e60f38e-5c85-42a7-9b6a-39cb4cd8dc68" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.992637] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7bcdadce-edf2-43d0-a8d9-43033bb27e63',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.173310] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcee84a2-5f8e-4aff-856c-81b817d31434 in Status: SUCCESS [ 629.173310] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcee84a2-5f8e-4aff-856c-81b817d31434" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.173310] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcee84a2-5f8e-4aff-856c-81b817d31434" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.173310] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcee84a2-5f8e-4aff-856c-81b817d31434" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.173310] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.173310] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.173310] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.173310] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.173310] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.173310] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcee84a2-5f8e-4aff-856c-81b817d31434" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.174065] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dcee84a2-5f8e-4aff-856c-81b817d31434',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.238294] env[65943]: INFO networking_nsxv3.common.synchronization [req-dab47d70-7058-4739-933e-d8b7daa5c068 req-fe3c0d7d-cec4-4486-9de7-23eea681f114 tempest-ServerTagsTestJSON-2057985827 tempest-ServerTagsTestJSON-2057985827-project-member] Enqueued Resource ID: 91dead58-0cf0-4aec-a2ae-571f8dc59b4c with Priority: HIGHEST for action security_group_members [ 629.238294] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91dead58-0cf0-4aec-a2ae-571f8dc59b4c with Priority: HIGHEST for action security_group_members [ 629.245662] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-91dead58-0cf0-4aec-a2ae-571f8dc59b4c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.245662] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91dead58-0cf0-4aec-a2ae-571f8dc59b4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.245662] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91dead58-0cf0-4aec-a2ae-571f8dc59b4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.245662] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91dead58-0cf0-4aec-a2ae-571f8dc59b4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.245662] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.245662] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.245662] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.245662] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.245662] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.245662] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('91dead58-0cf0-4aec-a2ae-571f8dc59b4c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.311643] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e02be8c7-70b1-4488-b079-b1ebf20a733c in Status: SUCCESS [ 629.311643] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.495891] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.496412] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.496682] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.497053] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.497613] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.497848] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 is going to be created. [ 629.529682] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.529923] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.529923] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.531510] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.531510] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.594203] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 in Status: UNINITIALIZED for 2s [ 629.677623] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dcee84a2-5f8e-4aff-856c-81b817d31434',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.746706] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.746927] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.747019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.747322] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.747428] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.747878] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.747878] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.748074] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.748110] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.748220] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.748310] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 91dead58-0cf0-4aec-a2ae-571f8dc59b4c already deleted. [ 629.748398] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91dead58-0cf0-4aec-a2ae-571f8dc59b4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.181490] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d97ff6f8-41cc-4974-82fe-bda7247ceb2b in Status: SUCCESS [ 630.182618] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d97ff6f8-41cc-4974-82fe-bda7247ceb2b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.182618] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dcee84a2-5f8e-4aff-856c-81b817d31434: rpc.has_security_group_logging(os_id): False [ 630.198174] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-17 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.198353] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.198467] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.198785] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.199053] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.199216] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.199324] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.199538] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.199672] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.199867] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 630.199984] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 630.200178] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 630.200178] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 630.200275] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 630.200369] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 630.201157] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 630.204308] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.204431] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.204520] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.204663] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.204748] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.204981] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.206929] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.206929] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.206929] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.206929] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.206929] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dcee84a2-5f8e-4aff-856c-81b817d31434 is going to be created. [ 630.224399] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 630.224562] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 630.224667] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 630.225967] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.225967] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-4ca755fb-5eb0-496f-be88-0300aa22bde2 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.225967] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-4ca755fb-5eb0-496f-be88-0300aa22bde2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.225967] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-4ca755fb-5eb0-496f-be88-0300aa22bde2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.226285] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-4ca755fb-5eb0-496f-be88-0300aa22bde2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.226285] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ca755fb-5eb0-496f-be88-0300aa22bde2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.274894] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.274894] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.274894] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.274894] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.274894] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.288864] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dcee84a2-5f8e-4aff-856c-81b817d31434 in Status: IN_PROGRESS for 2s [ 630.733025] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.733025] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.733025] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.733025] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.733025] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.733025] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port 4ca755fb-5eb0-496f-be88-0300aa22bde2 not found, creating... [ 630.733025] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.733025] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.733025] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.733025] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.733025] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.733624] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.733624] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.733624] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.733624] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.733624] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.733624] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: 4ca755fb-5eb0-496f-be88-0300aa22bde2 is going to be created. [ 630.755334] env[65943]: INFO networking_nsxv3.common.synchronization [None req-5d424a9f-d61a-4ab9-8069-f725440a57ae None None] Enqueued Resource ID: 62e252f3-1f13-4846-ad30-b2ae9fcf11df with Priority: HIGHEST for action port [ 630.755950] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.756393] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.756621] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.756976] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.757303] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.757624] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-4ca755fb-5eb0-496f-be88-0300aa22bde2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.759210] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62e252f3-1f13-4846-ad30-b2ae9fcf11df with Priority: HIGHEST for action port [ 630.759968] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-62e252f3-1f13-4846-ad30-b2ae9fcf11df taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.760229] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62e252f3-1f13-4846-ad30-b2ae9fcf11df" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.760388] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62e252f3-1f13-4846-ad30-b2ae9fcf11df" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.760717] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62e252f3-1f13-4846-ad30-b2ae9fcf11df" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.760892] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62e252f3-1f13-4846-ad30-b2ae9fcf11df',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.262794] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 62e252f3-1f13-4846-ad30-b2ae9fcf11df [ 631.263150] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.263416] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.263494] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.263718] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.263826] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.263929] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:62e252f3-1f13-4846-ad30-b2ae9fcf11df already deleted. [ 631.264072] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62e252f3-1f13-4846-ad30-b2ae9fcf11df" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.503643] env[65943]: INFO networking_nsxv3.common.synchronization [req-dab47d70-7058-4739-933e-d8b7daa5c068 req-0a448724-a22a-4225-bed6-aaee07697533 service nova] Enqueued Resource ID: 91dead58-0cf0-4aec-a2ae-571f8dc59b4c with Priority: HIGHEST for action security_group_rules [ 631.503643] env[65943]: INFO networking_nsxv3.common.synchronization [req-dab47d70-7058-4739-933e-d8b7daa5c068 req-0a448724-a22a-4225-bed6-aaee07697533 service nova] Enqueued Resource ID: 91dead58-0cf0-4aec-a2ae-571f8dc59b4c with Priority: HIGHEST for action security_group_members [ 631.503643] env[65943]: INFO networking_nsxv3.common.synchronization [req-dab47d70-7058-4739-933e-d8b7daa5c068 req-0a448724-a22a-4225-bed6-aaee07697533 service nova] Enqueued Resource ID: 4ca755fb-5eb0-496f-be88-0300aa22bde2 with Priority: HIGHEST for action port [ 631.503643] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91dead58-0cf0-4aec-a2ae-571f8dc59b4c with Priority: HIGHEST for action security_group_rules [ 631.503643] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91dead58-0cf0-4aec-a2ae-571f8dc59b4c with Priority: HIGHEST for action security_group_members [ 631.503643] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ca755fb-5eb0-496f-be88-0300aa22bde2 with Priority: HIGHEST for action port [ 631.504087] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-91dead58-0cf0-4aec-a2ae-571f8dc59b4c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.504087] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-91dead58-0cf0-4aec-a2ae-571f8dc59b4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.504087] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-91dead58-0cf0-4aec-a2ae-571f8dc59b4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.504285] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-91dead58-0cf0-4aec-a2ae-571f8dc59b4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.504339] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('91dead58-0cf0-4aec-a2ae-571f8dc59b4c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.506721] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-91dead58-0cf0-4aec-a2ae-571f8dc59b4c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.506721] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91dead58-0cf0-4aec-a2ae-571f8dc59b4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.506721] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91dead58-0cf0-4aec-a2ae-571f8dc59b4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.506721] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91dead58-0cf0-4aec-a2ae-571f8dc59b4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.506990] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.506990] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.506990] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.507295] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.507422] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.507554] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('91dead58-0cf0-4aec-a2ae-571f8dc59b4c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.513298] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ca755fb-5eb0-496f-be88-0300aa22bde2 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.513872] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ca755fb-5eb0-496f-be88-0300aa22bde2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.513872] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ca755fb-5eb0-496f-be88-0300aa22bde2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.514037] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ca755fb-5eb0-496f-be88-0300aa22bde2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.514037] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ca755fb-5eb0-496f-be88-0300aa22bde2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.604661] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 in Status: SUCCESS [ 631.605400] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.605706] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.605997] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.606306] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.606485] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.606583] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.606824] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.606950] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.607189] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.607341] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7bcdadce-edf2-43d0-a8d9-43033bb27e63',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.016113] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-91dead58-0cf0-4aec-a2ae-571f8dc59b4c taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.016413] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91dead58-0cf0-4aec-a2ae-571f8dc59b4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.016663] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('91dead58-0cf0-4aec-a2ae-571f8dc59b4c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.022537] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4ca755fb-5eb0-496f-be88-0300aa22bde2 with status ACTIVE [ 632.022782] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.022946] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.023027] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.023627] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.023732] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.023929] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.024040] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.024107] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.024267] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.024332] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.024548] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.024670] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.024732] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.024879] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.024975] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.025102] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4ca755fb-5eb0-496f-be88-0300aa22bde2 is going to be updated. [ 632.050588] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.050588] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.050588] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.050912] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.051125] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.051258] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ca755fb-5eb0-496f-be88-0300aa22bde2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.110417] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7bcdadce-edf2-43d0-a8d9-43033bb27e63',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.305570] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dcee84a2-5f8e-4aff-856c-81b817d31434 in Status: SUCCESS [ 632.305570] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dcee84a2-5f8e-4aff-856c-81b817d31434" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.524433] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('91dead58-0cf0-4aec-a2ae-571f8dc59b4c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.613808] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7bcdadce-edf2-43d0-a8d9-43033bb27e63: rpc.has_security_group_logging(os_id): False [ 632.634275] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.634482] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.634647] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.634716] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.634811] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.635108] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.635224] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.635292] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.635457] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.635535] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.635620] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 is going to be created. [ 632.724409] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.724616] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.724696] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.724957] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.725273] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.741370] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 in Status: IN_PROGRESS for 2s [ 632.995243] env[65943]: INFO networking_nsxv3.common.synchronization [None req-9ea6760d-be43-4df9-a736-4b96d5405d07 None None] Enqueued Resource ID: b6968116-080e-4bba-ab07-ec9b2677d770 with Priority: HIGHEST for action port [ 632.995807] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6968116-080e-4bba-ab07-ec9b2677d770 with Priority: HIGHEST for action port [ 632.997581] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6968116-080e-4bba-ab07-ec9b2677d770 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.997736] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6968116-080e-4bba-ab07-ec9b2677d770" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.997806] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6968116-080e-4bba-ab07-ec9b2677d770" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.998115] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6968116-080e-4bba-ab07-ec9b2677d770" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.998214] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6968116-080e-4bba-ab07-ec9b2677d770',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.028865] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.030117] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.030363] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.030702] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.030909] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.031139] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 91dead58-0cf0-4aec-a2ae-571f8dc59b4c is going to be created. [ 633.061340] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.062550] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.062550] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.062550] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.062802] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.074101] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91dead58-0cf0-4aec-a2ae-571f8dc59b4c in Status: UNINITIALIZED for 2s [ 633.406659] env[65943]: INFO networking_nsxv3.common.synchronization [None req-05d5f7ca-75f0-4ccd-aa2b-eb445c6e26a7 None None] Enqueued Resource ID: f91030cc-7ff8-4287-afcd-98a80902890d with Priority: HIGHEST for action port [ 633.408200] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f91030cc-7ff8-4287-afcd-98a80902890d with Priority: HIGHEST for action port [ 633.408200] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-f91030cc-7ff8-4287-afcd-98a80902890d taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.408200] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f91030cc-7ff8-4287-afcd-98a80902890d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.408200] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f91030cc-7ff8-4287-afcd-98a80902890d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.408200] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f91030cc-7ff8-4287-afcd-98a80902890d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.408200] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f91030cc-7ff8-4287-afcd-98a80902890d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.500275] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b6968116-080e-4bba-ab07-ec9b2677d770 [ 633.500469] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.500690] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.500690] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.500890] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.501573] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.501678] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b6968116-080e-4bba-ab07-ec9b2677d770 already deleted. [ 633.501769] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6968116-080e-4bba-ab07-ec9b2677d770" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.912672] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f91030cc-7ff8-4287-afcd-98a80902890d [ 633.912672] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.912672] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.912672] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.912672] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.912672] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.912672] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f91030cc-7ff8-4287-afcd-98a80902890d already deleted. [ 633.912672] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f91030cc-7ff8-4287-afcd-98a80902890d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.548021] env[65943]: INFO networking_nsxv3.common.synchronization [req-4faa28c8-86a0-4034-9a9f-5c22986478bb req-a16544da-3cbc-4705-9131-c7e57c6e5b01 tempest-InstanceActionsV221TestJSON-1819449024 tempest-InstanceActionsV221TestJSON-1819449024-project-member] Enqueued Resource ID: 4d778131-5833-4ecf-9479-3c14db301ff2 with Priority: HIGHEST for action security_group_members [ 634.548021] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d778131-5833-4ecf-9479-3c14db301ff2 with Priority: HIGHEST for action security_group_members [ 634.548021] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d778131-5833-4ecf-9479-3c14db301ff2 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.548021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d778131-5833-4ecf-9479-3c14db301ff2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.548021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d778131-5833-4ecf-9479-3c14db301ff2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.548720] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d778131-5833-4ecf-9479-3c14db301ff2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.548720] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.548720] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.548720] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.548892] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.549059] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.549140] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d778131-5833-4ecf-9479-3c14db301ff2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.755134] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 in Status: SUCCESS [ 634.755437] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.026050] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-975 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.026291] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-975" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.026475] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-975" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.026903] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-975" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.027290] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.027549] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.027710] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.028027] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.028269] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.028545] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 635.028985] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 635.028985] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 635.028985] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 635.029242] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 635.029296] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 635.029476] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 635.050130] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 635.050304] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 635.050471] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 635.051169] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-975" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.051658] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-65b79268-17ad-4fab-918f-724765cf06b3 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.051795] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-65b79268-17ad-4fab-918f-724765cf06b3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.051856] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-65b79268-17ad-4fab-918f-724765cf06b3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.052148] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-65b79268-17ad-4fab-918f-724765cf06b3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.052292] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65b79268-17ad-4fab-918f-724765cf06b3',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.053599] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.053855] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.053930] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.054139] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.054233] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.054435] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.054548] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.054611] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.054758] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.054832] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.054933] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d778131-5833-4ecf-9479-3c14db301ff2 already deleted. [ 635.055048] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d778131-5833-4ecf-9479-3c14db301ff2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.084918] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91dead58-0cf0-4aec-a2ae-571f8dc59b4c in Status: SUCCESS [ 635.085162] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91dead58-0cf0-4aec-a2ae-571f8dc59b4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.085352] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91dead58-0cf0-4aec-a2ae-571f8dc59b4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.085576] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91dead58-0cf0-4aec-a2ae-571f8dc59b4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.085787] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.085915] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.085971] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.086155] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.086255] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.086346] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91dead58-0cf0-4aec-a2ae-571f8dc59b4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.086438] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('91dead58-0cf0-4aec-a2ae-571f8dc59b4c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.373532] env[65943]: INFO networking_nsxv3.common.synchronization [None req-a3291769-3290-4da8-9f00-09294491525c None None] Enqueued Resource ID: 6569ae79-7d7a-4ef3-be15-03a7e4e75027 with Priority: HIGHEST for action port [ 635.374074] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6569ae79-7d7a-4ef3-be15-03a7e4e75027 with Priority: HIGHEST for action port [ 635.374420] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-6569ae79-7d7a-4ef3-be15-03a7e4e75027 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.374725] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6569ae79-7d7a-4ef3-be15-03a7e4e75027" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.374725] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6569ae79-7d7a-4ef3-be15-03a7e4e75027" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.374911] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6569ae79-7d7a-4ef3-be15-03a7e4e75027" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.375639] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6569ae79-7d7a-4ef3-be15-03a7e4e75027',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.557673] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.557673] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.557673] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.558107] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.558107] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.558170] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port 65b79268-17ad-4fab-918f-724765cf06b3 not found, creating... [ 635.558393] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.558547] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.558658] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.558871] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.558999] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.559286] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.559471] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.559609] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.559816] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.559942] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.560092] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: 65b79268-17ad-4fab-918f-724765cf06b3 is going to be created. [ 635.579920] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.580150] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.580272] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.580599] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.580841] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.581072] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-65b79268-17ad-4fab-918f-724765cf06b3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.593239] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-91dead58-0cf0-4aec-a2ae-571f8dc59b4c taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.593479] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91dead58-0cf0-4aec-a2ae-571f8dc59b4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.593586] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91dead58-0cf0-4aec-a2ae-571f8dc59b4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.593846] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91dead58-0cf0-4aec-a2ae-571f8dc59b4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.594066] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.594214] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.594284] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.594496] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.594632] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.594765] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91dead58-0cf0-4aec-a2ae-571f8dc59b4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.594956] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-91dead58-0cf0-4aec-a2ae-571f8dc59b4c taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.595068] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91dead58-0cf0-4aec-a2ae-571f8dc59b4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.595129] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91dead58-0cf0-4aec-a2ae-571f8dc59b4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.595319] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91dead58-0cf0-4aec-a2ae-571f8dc59b4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.595488] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.595849] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.595849] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.595849] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.596009] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.596564] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91dead58-0cf0-4aec-a2ae-571f8dc59b4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.596729] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('91dead58-0cf0-4aec-a2ae-571f8dc59b4c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.880635] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6569ae79-7d7a-4ef3-be15-03a7e4e75027 [ 635.880910] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.881073] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.881142] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.881361] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.881453] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.881545] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6569ae79-7d7a-4ef3-be15-03a7e4e75027 already deleted. [ 635.881670] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6569ae79-7d7a-4ef3-be15-03a7e4e75027" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.102328] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 91dead58-0cf0-4aec-a2ae-571f8dc59b4c: rpc.has_security_group_logging(os_id): False [ 636.129222] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.129338] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.129429] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.129698] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.129813] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.130093] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.130228] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.130315] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.130540] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.130674] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.131318] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.131455] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.131527] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.131717] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.131811] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.132081] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.132770] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.132770] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.132770] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.132770] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.132770] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 91dead58-0cf0-4aec-a2ae-571f8dc59b4c is going to be created. [ 636.258571] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.259059] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.259059] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.259437] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.259662] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.273652] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 91dead58-0cf0-4aec-a2ae-571f8dc59b4c in Status: IN_PROGRESS for 2s [ 636.395148] env[65943]: INFO networking_nsxv3.common.synchronization [req-4faa28c8-86a0-4034-9a9f-5c22986478bb req-febbb72d-50f2-47b4-b102-4f5fbb2cffa3 service nova] Enqueued Resource ID: 4d778131-5833-4ecf-9479-3c14db301ff2 with Priority: HIGHEST for action security_group_rules [ 636.395148] env[65943]: INFO networking_nsxv3.common.synchronization [req-4faa28c8-86a0-4034-9a9f-5c22986478bb req-febbb72d-50f2-47b4-b102-4f5fbb2cffa3 service nova] Enqueued Resource ID: 4d778131-5833-4ecf-9479-3c14db301ff2 with Priority: HIGHEST for action security_group_members [ 636.395148] env[65943]: INFO networking_nsxv3.common.synchronization [req-4faa28c8-86a0-4034-9a9f-5c22986478bb req-febbb72d-50f2-47b4-b102-4f5fbb2cffa3 service nova] Enqueued Resource ID: 65b79268-17ad-4fab-918f-724765cf06b3 with Priority: HIGHEST for action port [ 636.395148] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d778131-5833-4ecf-9479-3c14db301ff2 with Priority: HIGHEST for action security_group_rules [ 636.395148] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d778131-5833-4ecf-9479-3c14db301ff2 with Priority: HIGHEST for action security_group_members [ 636.395148] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65b79268-17ad-4fab-918f-724765cf06b3 with Priority: HIGHEST for action port [ 636.395148] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d778131-5833-4ecf-9479-3c14db301ff2 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.395148] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d778131-5833-4ecf-9479-3c14db301ff2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.395148] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d778131-5833-4ecf-9479-3c14db301ff2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.395148] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d778131-5833-4ecf-9479-3c14db301ff2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.395148] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d778131-5833-4ecf-9479-3c14db301ff2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.397514] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d778131-5833-4ecf-9479-3c14db301ff2 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.397514] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d778131-5833-4ecf-9479-3c14db301ff2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.397514] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d778131-5833-4ecf-9479-3c14db301ff2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.397756] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d778131-5833-4ecf-9479-3c14db301ff2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.397852] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.397964] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.398042] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.398207] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.398296] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.398391] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d778131-5833-4ecf-9479-3c14db301ff2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.399661] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-65b79268-17ad-4fab-918f-724765cf06b3 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.399779] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65b79268-17ad-4fab-918f-724765cf06b3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.399779] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65b79268-17ad-4fab-918f-724765cf06b3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.399925] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65b79268-17ad-4fab-918f-724765cf06b3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.400036] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65b79268-17ad-4fab-918f-724765cf06b3',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.902426] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4d778131-5833-4ecf-9479-3c14db301ff2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.903518] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d778131-5833-4ecf-9479-3c14db301ff2 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.903642] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d778131-5833-4ecf-9479-3c14db301ff2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.903979] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 65b79268-17ad-4fab-918f-724765cf06b3 with status ACTIVE [ 636.904431] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.904431] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.904431] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.904605] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.904641] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.904794] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.906023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.906023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.906023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.906023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.906023] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.906023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.907737] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.907737] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.907737] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.907737] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 65b79268-17ad-4fab-918f-724765cf06b3 is going to be updated. [ 636.929902] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.930120] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.930172] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.930368] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.930513] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.930663] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65b79268-17ad-4fab-918f-724765cf06b3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.406461] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4d778131-5833-4ecf-9479-3c14db301ff2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.757614] env[65943]: INFO networking_nsxv3.common.synchronization [req-cdbc749f-c6d7-4eb5-ac35-995f5c1afa65 req-f9302db8-8b04-456d-b99e-7ed5b55313d8 tempest-ServersAdminNegativeTestJSON-33136479 tempest-ServersAdminNegativeTestJSON-33136479-project-member] Enqueued Resource ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 with Priority: HIGHEST for action security_group_members [ 637.758242] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 with Priority: HIGHEST for action security_group_members [ 637.759213] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-df0b5076-3338-4b40-9ce6-994130c4b8d2 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.759374] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.759459] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.759778] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.759878] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.760010] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.760457] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.760843] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.760843] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.760843] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df0b5076-3338-4b40-9ce6-994130c4b8d2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.908833] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.910725] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.910725] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.910725] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.910725] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.910725] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d778131-5833-4ecf-9479-3c14db301ff2 is going to be created. [ 637.934919] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.935089] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.935131] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.935433] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.935940] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.946094] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d778131-5833-4ecf-9479-3c14db301ff2 in Status: UNINITIALIZED for 2s [ 637.967552] env[65943]: INFO networking_nsxv3.common.synchronization [None req-fbc0ceec-9d58-4db1-a8e2-2ed2a2d4e430 None None] Enqueued Resource ID: dc111dde-a9c7-432f-bb53-ce4ba75cfcc4 with Priority: HIGHEST for action port [ 637.968020] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc111dde-a9c7-432f-bb53-ce4ba75cfcc4 with Priority: HIGHEST for action port [ 637.968331] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc111dde-a9c7-432f-bb53-ce4ba75cfcc4 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.968454] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc111dde-a9c7-432f-bb53-ce4ba75cfcc4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.968520] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc111dde-a9c7-432f-bb53-ce4ba75cfcc4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.968783] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc111dde-a9c7-432f-bb53-ce4ba75cfcc4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.968983] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc111dde-a9c7-432f-bb53-ce4ba75cfcc4',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.264553] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df0b5076-3338-4b40-9ce6-994130c4b8d2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.286695] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 91dead58-0cf0-4aec-a2ae-571f8dc59b4c in Status: SUCCESS [ 638.286914] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-91dead58-0cf0-4aec-a2ae-571f8dc59b4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.454823] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-651 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.455033] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.455154] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.455490] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.455741] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.455893] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.456010] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.456482] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.456646] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.456838] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 638.456948] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 638.457063] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 638.457167] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 638.457270] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 638.457370] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 638.457502] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 638.471267] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dc111dde-a9c7-432f-bb53-ce4ba75cfcc4 [ 638.471733] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.471941] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.472015] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.472231] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.472324] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.472422] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dc111dde-a9c7-432f-bb53-ce4ba75cfcc4 already deleted. [ 638.472506] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc111dde-a9c7-432f-bb53-ce4ba75cfcc4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.476905] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 638.477117] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 638.477255] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 638.477422] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.477819] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-9874a654-2076-4be3-b558-ebbbefaf36d2 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.477991] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-9874a654-2076-4be3-b558-ebbbefaf36d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.478126] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-9874a654-2076-4be3-b558-ebbbefaf36d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.478428] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-9874a654-2076-4be3-b558-ebbbefaf36d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.478559] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9874a654-2076-4be3-b558-ebbbefaf36d2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.770388] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df0b5076-3338-4b40-9ce6-994130c4b8d2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.981537] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.981869] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.981869] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.985322] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.985624] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.985982] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port 9874a654-2076-4be3-b558-ebbbefaf36d2 not found, creating... [ 638.986361] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.986623] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.986819] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.987304] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.987467] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.987948] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.988308] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.988575] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.988872] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.989088] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.989324] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: 9874a654-2076-4be3-b558-ebbbefaf36d2 is going to be created. [ 639.010277] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.010487] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.010610] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.010888] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.011123] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.011380] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-9874a654-2076-4be3-b558-ebbbefaf36d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.272635] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.272873] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.272942] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.273297] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.273412] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.273463] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 is going to be updated. [ 639.315233] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.315594] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.315929] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.316225] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.316491] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.333645] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 in Status: IN_PROGRESS for 2s [ 639.758804] env[65943]: INFO networking_nsxv3.common.synchronization [req-cdbc749f-c6d7-4eb5-ac35-995f5c1afa65 req-049fd159-aa18-463f-8797-51f7fd876066 service nova] Enqueued Resource ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 with Priority: HIGHEST for action security_group_rules [ 639.759013] env[65943]: INFO networking_nsxv3.common.synchronization [req-cdbc749f-c6d7-4eb5-ac35-995f5c1afa65 req-049fd159-aa18-463f-8797-51f7fd876066 service nova] Enqueued Resource ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 with Priority: HIGHEST for action security_group_members [ 639.759828] env[65943]: INFO networking_nsxv3.common.synchronization [req-cdbc749f-c6d7-4eb5-ac35-995f5c1afa65 req-049fd159-aa18-463f-8797-51f7fd876066 service nova] Enqueued Resource ID: 9874a654-2076-4be3-b558-ebbbefaf36d2 with Priority: HIGHEST for action port [ 639.762266] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 with Priority: HIGHEST for action security_group_rules [ 639.762417] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 with Priority: HIGHEST for action security_group_members [ 639.762523] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9874a654-2076-4be3-b558-ebbbefaf36d2 with Priority: HIGHEST for action port [ 639.763162] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df0b5076-3338-4b40-9ce6-994130c4b8d2 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.763299] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.763369] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.763589] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.763671] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df0b5076-3338-4b40-9ce6-994130c4b8d2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.764945] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-df0b5076-3338-4b40-9ce6-994130c4b8d2 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.765066] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.765300] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-9874a654-2076-4be3-b558-ebbbefaf36d2 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.765407] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9874a654-2076-4be3-b558-ebbbefaf36d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.765474] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9874a654-2076-4be3-b558-ebbbefaf36d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.765658] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9874a654-2076-4be3-b558-ebbbefaf36d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.765737] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9874a654-2076-4be3-b558-ebbbefaf36d2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.810398] env[65943]: INFO networking_nsxv3.common.synchronization [None req-76457f02-a3ad-4093-be64-eedb1b36b499 None None] Enqueued Resource ID: 3285cf7c-cdbe-42f8-80fc-5f2745326466 with Priority: HIGHEST for action port [ 639.810398] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3285cf7c-cdbe-42f8-80fc-5f2745326466 with Priority: HIGHEST for action port [ 639.810398] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-3285cf7c-cdbe-42f8-80fc-5f2745326466 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.810398] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3285cf7c-cdbe-42f8-80fc-5f2745326466" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.810398] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3285cf7c-cdbe-42f8-80fc-5f2745326466" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.811208] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3285cf7c-cdbe-42f8-80fc-5f2745326466" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.811431] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3285cf7c-cdbe-42f8-80fc-5f2745326466',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.958022] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d778131-5833-4ecf-9479-3c14db301ff2 in Status: SUCCESS [ 639.958022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d778131-5833-4ecf-9479-3c14db301ff2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.958022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d778131-5833-4ecf-9479-3c14db301ff2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.958022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d778131-5833-4ecf-9479-3c14db301ff2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.958022] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.958022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.958022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.958022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.958022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.958022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d778131-5833-4ecf-9479-3c14db301ff2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.958022] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4d778131-5833-4ecf-9479-3c14db301ff2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.199024] env[65943]: INFO networking_nsxv3.common.synchronization [None req-fdf3e8bf-6774-4617-af96-c6753b5426af None None] Enqueued Resource ID: 2d893591-2576-479b-a422-938ccd04bc78 with Priority: HIGHEST for action port [ 640.199024] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d893591-2576-479b-a422-938ccd04bc78 with Priority: HIGHEST for action port [ 640.199024] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d893591-2576-479b-a422-938ccd04bc78 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.199024] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d893591-2576-479b-a422-938ccd04bc78" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.199024] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d893591-2576-479b-a422-938ccd04bc78" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.199887] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d893591-2576-479b-a422-938ccd04bc78" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.200104] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d893591-2576-479b-a422-938ccd04bc78',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.268429] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-df0b5076-3338-4b40-9ce6-994130c4b8d2 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.268429] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.276111] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9874a654-2076-4be3-b558-ebbbefaf36d2 with status ACTIVE [ 640.276111] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.276111] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.276111] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.276948] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.276948] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.276948] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.277152] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.277152] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.277475] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.277999] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.277999] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.277999] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.279404] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.279404] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.279404] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.279404] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9874a654-2076-4be3-b558-ebbbefaf36d2 is going to be updated. [ 640.306991] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.307183] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.307398] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.307755] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.308034] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.308298] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9874a654-2076-4be3-b558-ebbbefaf36d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.315016] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3285cf7c-cdbe-42f8-80fc-5f2745326466 [ 640.315111] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.315228] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.315301] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.315497] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.315586] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.315704] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3285cf7c-cdbe-42f8-80fc-5f2745326466 already deleted. [ 640.315789] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3285cf7c-cdbe-42f8-80fc-5f2745326466" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.460347] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d778131-5833-4ecf-9479-3c14db301ff2 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.460347] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d778131-5833-4ecf-9479-3c14db301ff2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.460520] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d778131-5833-4ecf-9479-3c14db301ff2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.460635] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d778131-5833-4ecf-9479-3c14db301ff2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.461221] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.461221] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.461533] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.461533] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.461611] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.461648] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d778131-5833-4ecf-9479-3c14db301ff2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.462166] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d778131-5833-4ecf-9479-3c14db301ff2 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.462166] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d778131-5833-4ecf-9479-3c14db301ff2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.462166] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d778131-5833-4ecf-9479-3c14db301ff2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.462166] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d778131-5833-4ecf-9479-3c14db301ff2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.464241] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.464241] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.464241] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.464241] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.464241] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.464241] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d778131-5833-4ecf-9479-3c14db301ff2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.464241] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4d778131-5833-4ecf-9479-3c14db301ff2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.703798] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2d893591-2576-479b-a422-938ccd04bc78 [ 640.703798] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.703798] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.703798] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.705960] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.705960] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.705960] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2d893591-2576-479b-a422-938ccd04bc78 already deleted. [ 640.705960] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d893591-2576-479b-a422-938ccd04bc78" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.965695] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4d778131-5833-4ecf-9479-3c14db301ff2: rpc.has_security_group_logging(os_id): False [ 640.990237] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.990435] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.990435] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.990651] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.990738] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.990920] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.991025] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.991088] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.992113] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.992240] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.996054] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.996054] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.996054] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.996054] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.996054] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.996054] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.996054] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.996054] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.996054] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.996054] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.996054] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d778131-5833-4ecf-9479-3c14db301ff2 is going to be created. [ 641.006912] env[65943]: INFO networking_nsxv3.common.synchronization [req-2d454129-74fc-4dd6-be53-5009e2cdc8cb req-da643ed5-60f7-4c0f-8a5c-f5344e3186b3 tempest-ServersTestBootFromVolume-62984311 tempest-ServersTestBootFromVolume-62984311-project-member] Enqueued Resource ID: 1059706e-9846-4d25-98c7-43c5aa686d19 with Priority: HIGHEST for action security_group_members [ 641.006912] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1059706e-9846-4d25-98c7-43c5aa686d19 with Priority: HIGHEST for action security_group_members [ 641.006993] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-1059706e-9846-4d25-98c7-43c5aa686d19 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.007538] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1059706e-9846-4d25-98c7-43c5aa686d19" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.007538] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1059706e-9846-4d25-98c7-43c5aa686d19" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.008662] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1059706e-9846-4d25-98c7-43c5aa686d19" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.008850] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.009011] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.009094] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.009295] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.009389] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.009489] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1059706e-9846-4d25-98c7-43c5aa686d19',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.055205] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.055388] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.055434] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.055665] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.056364] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.073737] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4d778131-5833-4ecf-9479-3c14db301ff2 in Status: IN_PROGRESS for 2s [ 641.345364] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 in Status: SUCCESS [ 641.345699] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.346871] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.346871] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.346871] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.346871] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.346871] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.347626] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.347626] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.347626] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df0b5076-3338-4b40-9ce6-994130c4b8d2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.490841] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-64 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.492316] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.492530] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.492917] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.493742] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.493986] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.494156] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.494438] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.494637] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.494887] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 641.495045] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 641.495472] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 641.496538] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 641.496723] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 641.496846] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 641.496988] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 641.511377] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.511729] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.511729] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.511882] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.511882] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.512300] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.512300] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.512300] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.512527] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.512527] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.512527] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1059706e-9846-4d25-98c7-43c5aa686d19 already deleted. [ 641.512977] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1059706e-9846-4d25-98c7-43c5aa686d19" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.521703] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 641.521876] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 641.522086] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 641.522237] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.522502] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-d80c72c3-92c9-4798-a663-d7dee5bdf531 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.522670] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-d80c72c3-92c9-4798-a663-d7dee5bdf531" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.522784] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-d80c72c3-92c9-4798-a663-d7dee5bdf531" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.523130] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-d80c72c3-92c9-4798-a663-d7dee5bdf531" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.523262] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d80c72c3-92c9-4798-a663-d7dee5bdf531',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.851158] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df0b5076-3338-4b40-9ce6-994130c4b8d2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.026695] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.026896] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.026998] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.027745] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.027745] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.027745] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port d80c72c3-92c9-4798-a663-d7dee5bdf531 not found, creating... [ 642.027996] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.028076] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.028154] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.028550] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.028550] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.028798] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.029099] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.029099] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.029272] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.029373] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.029514] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: d80c72c3-92c9-4798-a663-d7dee5bdf531 is going to be created. [ 642.050444] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.050684] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.050826] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.051724] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.051724] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.051724] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-d80c72c3-92c9-4798-a663-d7dee5bdf531" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.293480] env[65943]: INFO networking_nsxv3.common.synchronization [None req-649a9b66-9087-44d3-977c-86de94c1c9cb None None] Enqueued Resource ID: b95508a2-2237-45f4-beda-4b2e96030932 with Priority: HIGHEST for action port [ 642.294054] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95508a2-2237-45f4-beda-4b2e96030932 with Priority: HIGHEST for action port [ 642.294429] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-b95508a2-2237-45f4-beda-4b2e96030932 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.294559] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b95508a2-2237-45f4-beda-4b2e96030932" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.294641] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b95508a2-2237-45f4-beda-4b2e96030932" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.295347] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b95508a2-2237-45f4-beda-4b2e96030932" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.295420] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b95508a2-2237-45f4-beda-4b2e96030932',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.353530] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df0b5076-3338-4b40-9ce6-994130c4b8d2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.598260] env[65943]: INFO networking_nsxv3.common.synchronization [None req-9d568896-f375-47ab-a969-b03149703242 None None] Enqueued Resource ID: f9d98c2c-fdb8-4778-990f-2c8092200403 with Priority: HIGHEST for action port [ 642.598326] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9d98c2c-fdb8-4778-990f-2c8092200403 with Priority: HIGHEST for action port [ 642.598657] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9d98c2c-fdb8-4778-990f-2c8092200403 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.598796] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9d98c2c-fdb8-4778-990f-2c8092200403" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.598871] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9d98c2c-fdb8-4778-990f-2c8092200403" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.599262] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9d98c2c-fdb8-4778-990f-2c8092200403" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.599370] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9d98c2c-fdb8-4778-990f-2c8092200403',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.769851] env[65943]: INFO networking_nsxv3.common.synchronization [req-2d454129-74fc-4dd6-be53-5009e2cdc8cb req-68b0ce4e-4b28-4115-90db-2bbbf8922002 service nova] Enqueued Resource ID: 1059706e-9846-4d25-98c7-43c5aa686d19 with Priority: HIGHEST for action security_group_rules [ 642.769851] env[65943]: INFO networking_nsxv3.common.synchronization [req-2d454129-74fc-4dd6-be53-5009e2cdc8cb req-68b0ce4e-4b28-4115-90db-2bbbf8922002 service nova] Enqueued Resource ID: 1059706e-9846-4d25-98c7-43c5aa686d19 with Priority: HIGHEST for action security_group_members [ 642.770034] env[65943]: INFO networking_nsxv3.common.synchronization [req-2d454129-74fc-4dd6-be53-5009e2cdc8cb req-68b0ce4e-4b28-4115-90db-2bbbf8922002 service nova] Enqueued Resource ID: d80c72c3-92c9-4798-a663-d7dee5bdf531 with Priority: HIGHEST for action port [ 642.770200] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1059706e-9846-4d25-98c7-43c5aa686d19 with Priority: HIGHEST for action security_group_rules [ 642.770335] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1059706e-9846-4d25-98c7-43c5aa686d19 with Priority: HIGHEST for action security_group_members [ 642.770430] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d80c72c3-92c9-4798-a663-d7dee5bdf531 with Priority: HIGHEST for action port [ 642.771057] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1059706e-9846-4d25-98c7-43c5aa686d19 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.773263] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1059706e-9846-4d25-98c7-43c5aa686d19" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.773433] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1059706e-9846-4d25-98c7-43c5aa686d19" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.773597] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1059706e-9846-4d25-98c7-43c5aa686d19" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.773686] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1059706e-9846-4d25-98c7-43c5aa686d19',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.774943] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-1059706e-9846-4d25-98c7-43c5aa686d19 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.775102] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1059706e-9846-4d25-98c7-43c5aa686d19" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.775173] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1059706e-9846-4d25-98c7-43c5aa686d19" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.775410] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1059706e-9846-4d25-98c7-43c5aa686d19" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.775623] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.775776] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.775826] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.775945] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.778027] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.778167] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1059706e-9846-4d25-98c7-43c5aa686d19',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.779700] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-d80c72c3-92c9-4798-a663-d7dee5bdf531 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.779861] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d80c72c3-92c9-4798-a663-d7dee5bdf531" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.779937] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d80c72c3-92c9-4798-a663-d7dee5bdf531" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.780177] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d80c72c3-92c9-4798-a663-d7dee5bdf531" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.780252] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d80c72c3-92c9-4798-a663-d7dee5bdf531',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.797161] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b95508a2-2237-45f4-beda-4b2e96030932 [ 642.797422] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.797572] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.797672] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.797915] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.804298] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.804298] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b95508a2-2237-45f4-beda-4b2e96030932 already deleted. [ 642.804298] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b95508a2-2237-45f4-beda-4b2e96030932" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.856226] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.856502] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.856584] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.856914] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.857123] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.857210] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 is going to be updated. [ 642.897087] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.897279] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.897353] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.897683] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.897744] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.910545] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 in Status: IN_PROGRESS for 2s [ 643.088515] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4d778131-5833-4ecf-9479-3c14db301ff2 in Status: SUCCESS [ 643.088766] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d778131-5833-4ecf-9479-3c14db301ff2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.101770] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f9d98c2c-fdb8-4778-990f-2c8092200403 [ 643.102137] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.102224] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.103412] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.103412] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.103412] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.103412] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f9d98c2c-fdb8-4778-990f-2c8092200403 already deleted. [ 643.103412] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9d98c2c-fdb8-4778-990f-2c8092200403" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.281891] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-1059706e-9846-4d25-98c7-43c5aa686d19 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.282063] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1059706e-9846-4d25-98c7-43c5aa686d19" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.283866] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1059706e-9846-4d25-98c7-43c5aa686d19',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.284557] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d80c72c3-92c9-4798-a663-d7dee5bdf531 with status ACTIVE [ 643.284748] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.285067] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.285067] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.285443] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.285547] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.286373] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.286373] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.286373] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.286373] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.286373] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.286373] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.286754] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.286754] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.286754] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.286844] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.287463] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d80c72c3-92c9-4798-a663-d7dee5bdf531 is going to be updated. [ 643.311445] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.311445] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.311445] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.311445] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.311445] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.311445] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d80c72c3-92c9-4798-a663-d7dee5bdf531" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.518586] env[65943]: INFO networking_nsxv3.common.synchronization [req-aa216b44-609d-4673-b450-f584927fecd8 req-8966ace7-7c4c-412e-b17d-9076c776a6e7 tempest-ServersWithSpecificFlavorTestJSON-110328110 tempest-ServersWithSpecificFlavorTestJSON-110328110-project-member] Enqueued Resource ID: b88e0956-a799-4c5e-8e71-323151811fd1 with Priority: HIGHEST for action security_group_members [ 643.522039] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b88e0956-a799-4c5e-8e71-323151811fd1 with Priority: HIGHEST for action security_group_members [ 643.522039] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b88e0956-a799-4c5e-8e71-323151811fd1 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.522039] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.522039] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.522039] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.522039] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.522039] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.522039] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.522039] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.522039] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.522039] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b88e0956-a799-4c5e-8e71-323151811fd1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.789901] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1059706e-9846-4d25-98c7-43c5aa686d19',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.024157] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.024397] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.024512] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.024848] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.024990] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.025252] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.025377] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.025459] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.025652] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.025742] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.025824] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b88e0956-a799-4c5e-8e71-323151811fd1 already deleted. [ 644.025932] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.295895] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.295895] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.296051] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.296741] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.296741] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.296741] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1059706e-9846-4d25-98c7-43c5aa686d19 is going to be created. [ 644.299100] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-481 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.299521] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-481" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.299521] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-481" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.299829] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-481" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.300124] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.300288] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.300410] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.300633] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.300789] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.301008] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 644.301394] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 644.301394] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 644.301394] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 644.301597] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 644.301597] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 644.301709] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 644.329750] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 644.329934] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 644.330098] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 644.330302] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-481" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.330984] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-2badd380-19f7-48d1-941a-bd1e43ef2e9e taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.331521] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-2badd380-19f7-48d1-941a-bd1e43ef2e9e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.331521] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-2badd380-19f7-48d1-941a-bd1e43ef2e9e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.331875] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-2badd380-19f7-48d1-941a-bd1e43ef2e9e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.331988] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2badd380-19f7-48d1-941a-bd1e43ef2e9e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.338331] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.338331] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.338513] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.338938] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.338938] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.353430] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1059706e-9846-4d25-98c7-43c5aa686d19 in Status: UNINITIALIZED for 2s [ 644.834828] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.835363] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.835363] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.835569] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.835745] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.835954] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port 2badd380-19f7-48d1-941a-bd1e43ef2e9e not found, creating... [ 644.836292] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.836794] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.836968] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.837402] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.837579] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.837930] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.839187] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.839451] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.839738] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.839870] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.840024] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: 2badd380-19f7-48d1-941a-bd1e43ef2e9e is going to be created. [ 644.866653] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.866915] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.867055] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.867357] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.867628] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.867907] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-2badd380-19f7-48d1-941a-bd1e43ef2e9e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.930311] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 in Status: SUCCESS [ 644.931161] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.931161] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.931161] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.931529] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.931864] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.931985] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.932571] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.932571] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.932753] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.932833] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df0b5076-3338-4b40-9ce6-994130c4b8d2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.345951] env[65943]: INFO networking_nsxv3.common.synchronization [None req-41d64f39-337d-4020-a21f-721bfb61662b None None] Enqueued Resource ID: 600842e1-6088-4bf5-b9d0-5d901221b93a with Priority: HIGHEST for action port [ 645.347239] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 600842e1-6088-4bf5-b9d0-5d901221b93a with Priority: HIGHEST for action port [ 645.347623] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-600842e1-6088-4bf5-b9d0-5d901221b93a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.347850] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-600842e1-6088-4bf5-b9d0-5d901221b93a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.347850] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-600842e1-6088-4bf5-b9d0-5d901221b93a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.348174] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-600842e1-6088-4bf5-b9d0-5d901221b93a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.348320] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('600842e1-6088-4bf5-b9d0-5d901221b93a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.435271] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-df0b5076-3338-4b40-9ce6-994130c4b8d2 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.435607] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.435607] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.436059] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.436059] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.436244] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.436244] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.436371] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.438138] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.438138] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.438138] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-df0b5076-3338-4b40-9ce6-994130c4b8d2 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.438138] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.438138] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.438138] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.438138] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.438138] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.438138] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.438138] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.438138] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.438138] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.438138] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df0b5076-3338-4b40-9ce6-994130c4b8d2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.620192] env[65943]: INFO networking_nsxv3.common.synchronization [req-aa216b44-609d-4673-b450-f584927fecd8 req-3a731c09-aa05-4ea6-8346-7ee97ff1f96f service nova] Enqueued Resource ID: b88e0956-a799-4c5e-8e71-323151811fd1 with Priority: HIGHEST for action security_group_rules [ 645.620325] env[65943]: INFO networking_nsxv3.common.synchronization [req-aa216b44-609d-4673-b450-f584927fecd8 req-3a731c09-aa05-4ea6-8346-7ee97ff1f96f service nova] Enqueued Resource ID: b88e0956-a799-4c5e-8e71-323151811fd1 with Priority: HIGHEST for action security_group_members [ 645.620599] env[65943]: INFO networking_nsxv3.common.synchronization [req-aa216b44-609d-4673-b450-f584927fecd8 req-3a731c09-aa05-4ea6-8346-7ee97ff1f96f service nova] Enqueued Resource ID: 2badd380-19f7-48d1-941a-bd1e43ef2e9e with Priority: HIGHEST for action port [ 645.620660] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b88e0956-a799-4c5e-8e71-323151811fd1 with Priority: HIGHEST for action security_group_rules [ 645.620787] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b88e0956-a799-4c5e-8e71-323151811fd1 with Priority: HIGHEST for action security_group_members [ 645.620884] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2badd380-19f7-48d1-941a-bd1e43ef2e9e with Priority: HIGHEST for action port [ 645.621437] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b88e0956-a799-4c5e-8e71-323151811fd1 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.621605] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.621644] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.621812] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.621901] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b88e0956-a799-4c5e-8e71-323151811fd1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.622829] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b88e0956-a799-4c5e-8e71-323151811fd1 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.622829] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.622829] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.623296] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.623296] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.623296] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.623296] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.623509] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.623543] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.623639] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b88e0956-a799-4c5e-8e71-323151811fd1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.624633] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-2badd380-19f7-48d1-941a-bd1e43ef2e9e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.624748] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2badd380-19f7-48d1-941a-bd1e43ef2e9e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.624748] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2badd380-19f7-48d1-941a-bd1e43ef2e9e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.624852] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2badd380-19f7-48d1-941a-bd1e43ef2e9e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.624922] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2badd380-19f7-48d1-941a-bd1e43ef2e9e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.851760] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 600842e1-6088-4bf5-b9d0-5d901221b93a [ 645.851760] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.851760] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.851760] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.851760] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.851760] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.851760] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:600842e1-6088-4bf5-b9d0-5d901221b93a already deleted. [ 645.851760] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-600842e1-6088-4bf5-b9d0-5d901221b93a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.943438] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df0b5076-3338-4b40-9ce6-994130c4b8d2: rpc.has_security_group_logging(os_id): False [ 645.961623] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.961773] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.961878] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.962156] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.962253] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.962451] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.962551] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.962614] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.962773] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.962844] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.963090] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.963169] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.963209] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.963391] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.963474] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.963677] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.963770] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.963831] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.963970] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.964059] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.964143] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 is going to be updated. [ 646.027634] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.030030] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.030030] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.030030] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.030030] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.042074] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 in Status: IN_PROGRESS for 2s [ 646.126603] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b88e0956-a799-4c5e-8e71-323151811fd1 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.127823] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.128149] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b88e0956-a799-4c5e-8e71-323151811fd1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.131356] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2badd380-19f7-48d1-941a-bd1e43ef2e9e with status ACTIVE [ 646.132801] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.134127] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.134222] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.134664] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.134664] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.134867] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.134977] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.135082] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.135388] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.135484] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.135789] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.136159] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.136159] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.136269] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.136396] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.136604] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2badd380-19f7-48d1-941a-bd1e43ef2e9e is going to be updated. [ 646.172916] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.172916] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.172916] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.173190] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.173190] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.173588] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2badd380-19f7-48d1-941a-bd1e43ef2e9e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.370619] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1059706e-9846-4d25-98c7-43c5aa686d19 in Status: SUCCESS [ 646.370619] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1059706e-9846-4d25-98c7-43c5aa686d19" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.370619] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1059706e-9846-4d25-98c7-43c5aa686d19" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.370853] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1059706e-9846-4d25-98c7-43c5aa686d19" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.371036] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.371219] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.371278] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.371492] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.371600] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.371719] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1059706e-9846-4d25-98c7-43c5aa686d19" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.371838] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1059706e-9846-4d25-98c7-43c5aa686d19',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.632438] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b88e0956-a799-4c5e-8e71-323151811fd1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.729609] env[65943]: INFO networking_nsxv3.common.synchronization [None req-901e4405-7095-4086-8b30-0f20d14c1bb7 None None] Enqueued Resource ID: 43baf6dd-af2a-4934-9d20-c40de8900947 with Priority: HIGHEST for action port [ 646.730326] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43baf6dd-af2a-4934-9d20-c40de8900947 with Priority: HIGHEST for action port [ 646.730655] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-43baf6dd-af2a-4934-9d20-c40de8900947 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.730840] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43baf6dd-af2a-4934-9d20-c40de8900947" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.730916] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43baf6dd-af2a-4934-9d20-c40de8900947" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.731341] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43baf6dd-af2a-4934-9d20-c40de8900947" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.731518] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43baf6dd-af2a-4934-9d20-c40de8900947',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.879226] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1059706e-9846-4d25-98c7-43c5aa686d19',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.135886] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.135886] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.136261] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.136261] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.136261] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.138202] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b88e0956-a799-4c5e-8e71-323151811fd1 is going to be created. [ 647.169760] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.169988] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.170137] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.170436] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.170655] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.182953] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b88e0956-a799-4c5e-8e71-323151811fd1 in Status: UNINITIALIZED for 2s [ 647.234533] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 43baf6dd-af2a-4934-9d20-c40de8900947 [ 647.234702] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.234793] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.234861] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.235115] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.235212] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.235310] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:43baf6dd-af2a-4934-9d20-c40de8900947 already deleted. [ 647.235411] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43baf6dd-af2a-4934-9d20-c40de8900947" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.382635] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1059706e-9846-4d25-98c7-43c5aa686d19: rpc.has_security_group_logging(os_id): False [ 647.402120] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.402288] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.402345] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.402596] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.403029] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.403029] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.403255] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.403255] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.403393] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.403444] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.403927] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1059706e-9846-4d25-98c7-43c5aa686d19 is going to be created. [ 647.515186] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.515321] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.515423] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.515691] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.515944] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.533058] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1059706e-9846-4d25-98c7-43c5aa686d19 in Status: IN_PROGRESS for 2s [ 647.931155] env[65943]: INFO networking_nsxv3.common.synchronization [req-7b63fdfe-4ba0-43f5-bbc5-9fe1093d0d4e req-ee92b7df-521f-4089-8702-3872184fdba2 tempest-ServerDiskConfigTestJSON-397438939 tempest-ServerDiskConfigTestJSON-397438939-project-member] Enqueued Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_members [ 647.931720] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_members [ 647.932036] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b127ff-135f-4cd2-9456-bc11d98737ce taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.932160] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.932224] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.933185] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.933427] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.933590] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.933693] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.933928] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.934458] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.934458] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.062336] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 in Status: SUCCESS [ 648.062336] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.440091] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.440091] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.440091] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.440091] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.440091] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.440091] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.440091] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.440091] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.440091] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.440091] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.440091] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9b127ff-135f-4cd2-9456-bc11d98737ce already deleted. [ 648.440091] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.803564] env[65943]: INFO networking_nsxv3.common.synchronization [None req-fb9f9a74-e1ce-42ed-9090-9695a2f5f45e tempest-ServerActionsV293TestJSON-838257534 tempest-ServerActionsV293TestJSON-838257534-project-member] Enqueued Resource ID: a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 with Priority: HIGHEST for action security_group_rules [ 648.808158] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 with Priority: HIGHEST for action security_group_rules [ 648.809440] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.809440] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.809440] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.809856] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.810010] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4f83bf4-ed34-4088-a422-46a4d9e5c7e1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.841386] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-327 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.841645] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-327" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.841645] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-327" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.842058] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-327" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.843610] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.843864] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.844039] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.844772] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.845247] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.845297] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 648.845550] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 648.845853] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 648.846287] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 648.846448] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 648.846801] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 648.846801] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 648.875590] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 648.875811] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 648.876170] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 648.876488] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-327" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.876834] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-8f494496-bee3-4e09-b63f-06f1337db30a taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.877113] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-8f494496-bee3-4e09-b63f-06f1337db30a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.878030] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-8f494496-bee3-4e09-b63f-06f1337db30a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.878030] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-8f494496-bee3-4e09-b63f-06f1337db30a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.878030] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f494496-bee3-4e09-b63f-06f1337db30a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.909461] env[65943]: INFO networking_nsxv3.common.synchronization [None req-b5294fe5-2b53-45f9-b4e1-e4be7d6dbb83 None None] Enqueued Resource ID: 593a2923-3ad0-4d61-9b8e-8859c7bf63b3 with Priority: HIGHEST for action port [ 648.909986] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 593a2923-3ad0-4d61-9b8e-8859c7bf63b3 with Priority: HIGHEST for action port [ 648.910356] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-593a2923-3ad0-4d61-9b8e-8859c7bf63b3 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.910493] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-593a2923-3ad0-4d61-9b8e-8859c7bf63b3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.910569] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-593a2923-3ad0-4d61-9b8e-8859c7bf63b3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.910985] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-593a2923-3ad0-4d61-9b8e-8859c7bf63b3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.910985] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('593a2923-3ad0-4d61-9b8e-8859c7bf63b3',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.195318] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b88e0956-a799-4c5e-8e71-323151811fd1 in Status: SUCCESS [ 649.195811] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.195811] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.196653] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.196653] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.196653] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.196653] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.196653] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.197055] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.197055] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.197055] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b88e0956-a799-4c5e-8e71-323151811fd1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.337302] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.337598] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.337598] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.337822] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.337925] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.338048] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 already deleted. [ 649.338144] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.380335] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.380736] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.380736] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.380991] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.381224] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.381404] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port 8f494496-bee3-4e09-b63f-06f1337db30a not found, creating... [ 649.381668] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.381820] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.381931] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.382181] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.382374] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.382669] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.382819] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.382928] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.383149] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.383305] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.383508] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: 8f494496-bee3-4e09-b63f-06f1337db30a is going to be created. [ 649.409845] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.410119] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.410243] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.410533] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.410771] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.411146] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-8f494496-bee3-4e09-b63f-06f1337db30a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.413900] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 593a2923-3ad0-4d61-9b8e-8859c7bf63b3 [ 649.414144] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.414279] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.414352] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.414732] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.414732] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.414861] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:593a2923-3ad0-4d61-9b8e-8859c7bf63b3 already deleted. [ 649.414861] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-593a2923-3ad0-4d61-9b8e-8859c7bf63b3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.550638] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1059706e-9846-4d25-98c7-43c5aa686d19 in Status: SUCCESS [ 649.550957] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1059706e-9846-4d25-98c7-43c5aa686d19" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.702225] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b88e0956-a799-4c5e-8e71-323151811fd1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.047442] env[65943]: INFO networking_nsxv3.common.synchronization [None req-d74f4568-04ad-4659-98ca-dd48953ff1f5 tempest-ServerActionsV293TestJSON-838257534 tempest-ServerActionsV293TestJSON-838257534-project-member] Enqueued Resource ID: a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 with Priority: HIGHEST for action security_group_rules [ 650.048193] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 with Priority: HIGHEST for action security_group_rules [ 650.051843] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.051843] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.051843] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.052176] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.052176] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4f83bf4-ed34-4088-a422-46a4d9e5c7e1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.186148] env[65943]: INFO networking_nsxv3.common.synchronization [req-7b63fdfe-4ba0-43f5-bbc5-9fe1093d0d4e req-28a45c09-a41c-4645-a133-1f8f7ed89704 service nova] Enqueued Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_rules [ 650.186342] env[65943]: INFO networking_nsxv3.common.synchronization [req-7b63fdfe-4ba0-43f5-bbc5-9fe1093d0d4e req-28a45c09-a41c-4645-a133-1f8f7ed89704 service nova] Enqueued Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_members [ 650.186552] env[65943]: INFO networking_nsxv3.common.synchronization [req-7b63fdfe-4ba0-43f5-bbc5-9fe1093d0d4e req-28a45c09-a41c-4645-a133-1f8f7ed89704 service nova] Enqueued Resource ID: 8f494496-bee3-4e09-b63f-06f1337db30a with Priority: HIGHEST for action port [ 650.187201] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_rules [ 650.187372] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_members [ 650.187490] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f494496-bee3-4e09-b63f-06f1337db30a with Priority: HIGHEST for action port [ 650.187765] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9b127ff-135f-4cd2-9456-bc11d98737ce taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.188279] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.188352] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.189012] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.189109] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.190282] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b127ff-135f-4cd2-9456-bc11d98737ce taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.190434] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.190491] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.190686] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.191393] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.191577] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.191694] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.193525] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.193525] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.193525] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.193862] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f494496-bee3-4e09-b63f-06f1337db30a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.194021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f494496-bee3-4e09-b63f-06f1337db30a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.194721] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f494496-bee3-4e09-b63f-06f1337db30a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.194721] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f494496-bee3-4e09-b63f-06f1337db30a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.194721] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f494496-bee3-4e09-b63f-06f1337db30a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.204561] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b88e0956-a799-4c5e-8e71-323151811fd1: rpc.has_security_group_logging(os_id): False [ 650.229177] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.229177] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.229177] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.229177] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.229177] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.229177] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.229177] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.229177] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.229177] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.229177] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.229177] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b88e0956-a799-4c5e-8e71-323151811fd1 is going to be created. [ 650.308214] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.308214] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.308214] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.308480] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.308636] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.324066] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b88e0956-a799-4c5e-8e71-323151811fd1 in Status: IN_PROGRESS for 2s [ 650.490264] env[65943]: INFO networking_nsxv3.common.synchronization [None req-10e8bd3e-f66b-44a0-aa19-7ef17c53bbd2 None None] Enqueued Resource ID: d4a36c4e-9762-4537-affa-d13aa1f1f82c with Priority: HIGHEST for action port [ 650.490785] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4a36c4e-9762-4537-affa-d13aa1f1f82c with Priority: HIGHEST for action port [ 650.491173] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4a36c4e-9762-4537-affa-d13aa1f1f82c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.491251] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4a36c4e-9762-4537-affa-d13aa1f1f82c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.491320] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4a36c4e-9762-4537-affa-d13aa1f1f82c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.491626] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4a36c4e-9762-4537-affa-d13aa1f1f82c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.491724] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4a36c4e-9762-4537-affa-d13aa1f1f82c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.577303] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.577460] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.577514] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.577721] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.577822] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.578262] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 already deleted. [ 650.578262] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.696797] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b127ff-135f-4cd2-9456-bc11d98737ce taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.696933] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.698283] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.699394] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8f494496-bee3-4e09-b63f-06f1337db30a with status ACTIVE [ 650.699692] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.699831] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.699926] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.700164] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.700254] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.700599] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.700704] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.700765] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.700929] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.701024] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.701208] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.701698] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.701804] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.701986] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.702107] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.702219] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8f494496-bee3-4e09-b63f-06f1337db30a is going to be updated. [ 650.728660] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.730098] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.730098] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.730098] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.730098] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.730098] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f494496-bee3-4e09-b63f-06f1337db30a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.994910] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d4a36c4e-9762-4537-affa-d13aa1f1f82c [ 650.995256] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.995365] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.995472] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.995643] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.995722] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.995814] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d4a36c4e-9762-4537-affa-d13aa1f1f82c already deleted. [ 650.996350] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4a36c4e-9762-4537-affa-d13aa1f1f82c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.204982] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.285462] env[65943]: INFO networking_nsxv3.common.synchronization [req-34dff064-64b3-4d36-ad6e-54740b3a78e3 req-8f1b1323-1cfa-488b-a4b7-4d202cdddeac tempest-AttachInterfacesV270Test-1116323746 tempest-AttachInterfacesV270Test-1116323746-project-member] Enqueued Resource ID: 4d0b6f8c-385a-4740-8634-e522537eba0d with Priority: HIGHEST for action security_group_members [ 651.287015] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d0b6f8c-385a-4740-8634-e522537eba0d with Priority: HIGHEST for action security_group_members [ 651.289371] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d0b6f8c-385a-4740-8634-e522537eba0d taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.289371] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d0b6f8c-385a-4740-8634-e522537eba0d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.289371] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d0b6f8c-385a-4740-8634-e522537eba0d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.289371] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d0b6f8c-385a-4740-8634-e522537eba0d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.289371] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.289371] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.289371] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.289371] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.289371] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.289371] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d0b6f8c-385a-4740-8634-e522537eba0d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.709569] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.709755] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.710248] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.710248] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.710248] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.710248] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9b127ff-135f-4cd2-9456-bc11d98737ce is going to be created. [ 651.721334] env[65943]: INFO networking_nsxv3.common.synchronization [req-8f0a09c8-671f-4030-8b5f-200ca3236671 req-ab2fdb5a-44d1-47f9-9a8f-2398a4c11e7f tempest-DeleteServersAdminTestJSON-941821739 tempest-DeleteServersAdminTestJSON-941821739-project-member] Enqueued Resource ID: e550f237-9e27-45ea-9e02-516ac8d2852f with Priority: HIGHEST for action security_group_members [ 651.721334] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e550f237-9e27-45ea-9e02-516ac8d2852f with Priority: HIGHEST for action security_group_members [ 651.721334] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e550f237-9e27-45ea-9e02-516ac8d2852f taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.721334] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.721334] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.721334] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.721334] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.721334] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.721334] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.721334] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.722453] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.722453] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e550f237-9e27-45ea-9e02-516ac8d2852f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.750949] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.750949] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.750949] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.750949] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.750949] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.761691] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b127ff-135f-4cd2-9456-bc11d98737ce in Status: UNINITIALIZED for 2s [ 651.797141] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.797141] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.797141] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.797141] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.797141] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.797141] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.797141] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.797141] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.797141] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.797688] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.797688] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d0b6f8c-385a-4740-8634-e522537eba0d is going to be updated. [ 651.844219] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.844219] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.844219] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.844219] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.844219] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.856722] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d0b6f8c-385a-4740-8634-e522537eba0d in Status: IN_PROGRESS for 2s [ 652.225274] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.225799] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.225799] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.225963] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.226207] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.226506] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.226660] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.226732] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.226904] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.227012] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.227147] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e550f237-9e27-45ea-9e02-516ac8d2852f is going to be updated. [ 652.262563] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.264111] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.264210] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.264396] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.264549] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.278707] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e550f237-9e27-45ea-9e02-516ac8d2852f in Status: IN_PROGRESS for 2s [ 652.339163] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b88e0956-a799-4c5e-8e71-323151811fd1 in Status: SUCCESS [ 652.339163] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.364751] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-651 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.367143] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.367143] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.367143] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.367143] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.367143] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.367143] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.367143] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.367143] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.367143] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 652.367143] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 652.367143] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 652.367143] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 652.367143] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 652.367143] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 652.367866] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 652.390221] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 652.390871] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 652.391178] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 652.391471] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.392089] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-de0af43c-4193-4287-92b2-c24d857f640c taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.392563] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-de0af43c-4193-4287-92b2-c24d857f640c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.393180] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-de0af43c-4193-4287-92b2-c24d857f640c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.393624] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-de0af43c-4193-4287-92b2-c24d857f640c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.393864] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de0af43c-4193-4287-92b2-c24d857f640c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.642202] env[65943]: INFO networking_nsxv3.common.synchronization [req-b456c789-4670-4611-a09d-478f413a4f79 req-bb5dfeee-db83-47a5-bf0b-31f9fb9a16d9 tempest-ServerMetadataTestJSON-106407786 tempest-ServerMetadataTestJSON-106407786-project-member] Enqueued Resource ID: 78f53cda-281e-4098-b286-926afd0b084e with Priority: HIGHEST for action security_group_members [ 652.642767] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78f53cda-281e-4098-b286-926afd0b084e with Priority: HIGHEST for action security_group_members [ 652.643271] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-78f53cda-281e-4098-b286-926afd0b084e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.644116] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78f53cda-281e-4098-b286-926afd0b084e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.644116] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78f53cda-281e-4098-b286-926afd0b084e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.644116] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78f53cda-281e-4098-b286-926afd0b084e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.644116] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.645030] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.645256] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.645376] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.645602] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.645721] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78f53cda-281e-4098-b286-926afd0b084e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.898776] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.898776] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.899059] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.899194] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.899341] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.899489] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port de0af43c-4193-4287-92b2-c24d857f640c not found, creating... [ 652.899773] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.900269] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.900269] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.900538] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.900715] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.901120] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.901341] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.901523] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.901707] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.901834] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.901974] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: de0af43c-4193-4287-92b2-c24d857f640c is going to be created. [ 652.927994] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.928671] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.928671] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.928671] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.928838] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.928939] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-de0af43c-4193-4287-92b2-c24d857f640c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.148501] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.148701] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.148748] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.149112] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.149229] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.149491] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.149659] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.149709] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.149944] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.150061] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.150151] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78f53cda-281e-4098-b286-926afd0b084e already deleted. [ 653.150243] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78f53cda-281e-4098-b286-926afd0b084e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.424058] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-742 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.424467] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-742" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.424467] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-742" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.424791] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-742" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.424931] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.425105] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.425215] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.425476] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.425609] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.425814] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 653.425921] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 653.426039] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 653.426145] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 653.426245] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 653.426342] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 653.426469] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 653.446260] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 653.446465] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 653.446638] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 653.446956] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-742" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.447583] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-ea4050e2-26be-4e7b-8e45-6c0b0a8a5e08 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.447764] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-ea4050e2-26be-4e7b-8e45-6c0b0a8a5e08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.447880] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-ea4050e2-26be-4e7b-8e45-6c0b0a8a5e08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.448235] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-ea4050e2-26be-4e7b-8e45-6c0b0a8a5e08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.448388] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea4050e2-26be-4e7b-8e45-6c0b0a8a5e08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.544837] env[65943]: INFO networking_nsxv3.common.synchronization [None req-cc743b66-0f5a-4800-af0b-4b68f26a6973 None None] Enqueued Resource ID: 8ef94575-9f0e-4b6a-becf-7278d18201a5 with Priority: HIGHEST for action port [ 653.545499] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ef94575-9f0e-4b6a-becf-7278d18201a5 with Priority: HIGHEST for action port [ 653.546631] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ef94575-9f0e-4b6a-becf-7278d18201a5 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.546631] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ef94575-9f0e-4b6a-becf-7278d18201a5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.546631] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ef94575-9f0e-4b6a-becf-7278d18201a5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.547015] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ef94575-9f0e-4b6a-becf-7278d18201a5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.547081] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ef94575-9f0e-4b6a-becf-7278d18201a5',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.664789] env[65943]: INFO networking_nsxv3.common.synchronization [req-8f0a09c8-671f-4030-8b5f-200ca3236671 req-b4930151-c465-4c56-876f-8cf116fed788 service nova] Enqueued Resource ID: e550f237-9e27-45ea-9e02-516ac8d2852f with Priority: HIGHEST for action security_group_rules [ 653.665063] env[65943]: INFO networking_nsxv3.common.synchronization [req-8f0a09c8-671f-4030-8b5f-200ca3236671 req-b4930151-c465-4c56-876f-8cf116fed788 service nova] Enqueued Resource ID: e550f237-9e27-45ea-9e02-516ac8d2852f with Priority: HIGHEST for action security_group_members [ 653.665252] env[65943]: INFO networking_nsxv3.common.synchronization [req-8f0a09c8-671f-4030-8b5f-200ca3236671 req-b4930151-c465-4c56-876f-8cf116fed788 service nova] Enqueued Resource ID: de0af43c-4193-4287-92b2-c24d857f640c with Priority: HIGHEST for action port [ 653.667659] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e550f237-9e27-45ea-9e02-516ac8d2852f with Priority: HIGHEST for action security_group_rules [ 653.667863] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e550f237-9e27-45ea-9e02-516ac8d2852f with Priority: HIGHEST for action security_group_members [ 653.668271] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de0af43c-4193-4287-92b2-c24d857f640c with Priority: HIGHEST for action port [ 653.668611] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e550f237-9e27-45ea-9e02-516ac8d2852f taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.668894] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.668894] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.669577] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.669577] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e550f237-9e27-45ea-9e02-516ac8d2852f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.670149] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e550f237-9e27-45ea-9e02-516ac8d2852f taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.670284] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.670475] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-de0af43c-4193-4287-92b2-c24d857f640c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.670621] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de0af43c-4193-4287-92b2-c24d857f640c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.670621] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de0af43c-4193-4287-92b2-c24d857f640c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.670917] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de0af43c-4193-4287-92b2-c24d857f640c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.670917] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de0af43c-4193-4287-92b2-c24d857f640c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.774260] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b127ff-135f-4cd2-9456-bc11d98737ce in Status: SUCCESS [ 653.774583] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.774802] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.775094] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.775476] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.775624] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.775686] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.775849] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.775952] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.776044] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.776173] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.868451] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d0b6f8c-385a-4740-8634-e522537eba0d in Status: SUCCESS [ 653.868736] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d0b6f8c-385a-4740-8634-e522537eba0d deletion is rescheduled due to dependency. [ 653.868847] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d0b6f8c-385a-4740-8634-e522537eba0d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.951965] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.951965] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.951965] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.951965] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.952370] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.952370] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port ea4050e2-26be-4e7b-8e45-6c0b0a8a5e08 not found, creating... [ 653.952740] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.952841] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.953527] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.953527] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.953527] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.953692] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.953788] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.953937] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.954222] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.954435] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.954709] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: ea4050e2-26be-4e7b-8e45-6c0b0a8a5e08 is going to be created. [ 653.978405] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.980966] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.981087] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.981457] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.981610] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.981853] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-ea4050e2-26be-4e7b-8e45-6c0b0a8a5e08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.051064] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8ef94575-9f0e-4b6a-becf-7278d18201a5 [ 654.051614] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.051833] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.051939] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.052418] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.052418] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.052830] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8ef94575-9f0e-4b6a-becf-7278d18201a5 already deleted. [ 654.052830] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ef94575-9f0e-4b6a-becf-7278d18201a5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.177591] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e550f237-9e27-45ea-9e02-516ac8d2852f taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.177705] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.178294] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port de0af43c-4193-4287-92b2-c24d857f640c with status ACTIVE [ 654.178294] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.178606] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.178606] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.179059] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.179059] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.179213] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.179341] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.179396] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.179663] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.179920] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.180024] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.180106] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.180150] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.180346] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.180410] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.180452] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: de0af43c-4193-4287-92b2-c24d857f640c is going to be updated. [ 654.204818] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.205015] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.205090] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.205321] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.205521] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.206077] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de0af43c-4193-4287-92b2-c24d857f640c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.281570] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b127ff-135f-4cd2-9456-bc11d98737ce taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.281718] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.281757] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.281983] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.282200] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.282427] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.282590] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.282712] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.282807] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.282900] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.283252] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b127ff-135f-4cd2-9456-bc11d98737ce taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.283252] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.283383] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.283542] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.283692] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.283786] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.283842] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.283988] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.284081] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.284165] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.284260] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.299146] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e550f237-9e27-45ea-9e02-516ac8d2852f in Status: SUCCESS [ 654.299586] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e550f237-9e27-45ea-9e02-516ac8d2852f deletion is rescheduled due to dependency. [ 654.299762] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.300588] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.300910] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.301234] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.301443] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.301562] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.301830] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.301988] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.302154] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e550f237-9e27-45ea-9e02-516ac8d2852f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.787896] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9b127ff-135f-4cd2-9456-bc11d98737ce: rpc.has_security_group_logging(os_id): False [ 654.805823] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e550f237-9e27-45ea-9e02-516ac8d2852f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.807783] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.807910] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.807951] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.808180] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.808270] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.808479] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.808590] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.808653] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.808802] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.808879] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.810022] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.810502] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.810502] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.810502] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.810502] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.810735] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.811400] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.811400] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.811400] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.811400] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.811400] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9b127ff-135f-4cd2-9456-bc11d98737ce is going to be created. [ 654.816379] env[65943]: INFO networking_nsxv3.common.synchronization [req-b456c789-4670-4611-a09d-478f413a4f79 req-4522a33f-ee12-420a-b3ac-ef77c4610b86 service nova] Enqueued Resource ID: 78f53cda-281e-4098-b286-926afd0b084e with Priority: HIGHEST for action security_group_rules [ 654.816561] env[65943]: INFO networking_nsxv3.common.synchronization [req-b456c789-4670-4611-a09d-478f413a4f79 req-4522a33f-ee12-420a-b3ac-ef77c4610b86 service nova] Enqueued Resource ID: 78f53cda-281e-4098-b286-926afd0b084e with Priority: HIGHEST for action security_group_members [ 654.816722] env[65943]: INFO networking_nsxv3.common.synchronization [req-b456c789-4670-4611-a09d-478f413a4f79 req-4522a33f-ee12-420a-b3ac-ef77c4610b86 service nova] Enqueued Resource ID: ea4050e2-26be-4e7b-8e45-6c0b0a8a5e08 with Priority: HIGHEST for action port [ 654.817564] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78f53cda-281e-4098-b286-926afd0b084e with Priority: HIGHEST for action security_group_rules [ 654.817564] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78f53cda-281e-4098-b286-926afd0b084e with Priority: HIGHEST for action security_group_members [ 654.817564] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea4050e2-26be-4e7b-8e45-6c0b0a8a5e08 with Priority: HIGHEST for action port [ 654.818025] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78f53cda-281e-4098-b286-926afd0b084e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.818025] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78f53cda-281e-4098-b286-926afd0b084e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.818171] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78f53cda-281e-4098-b286-926afd0b084e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.818336] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78f53cda-281e-4098-b286-926afd0b084e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.818439] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78f53cda-281e-4098-b286-926afd0b084e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.819341] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-78f53cda-281e-4098-b286-926afd0b084e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.819733] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78f53cda-281e-4098-b286-926afd0b084e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.819733] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78f53cda-281e-4098-b286-926afd0b084e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.819733] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78f53cda-281e-4098-b286-926afd0b084e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.819887] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.819937] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.820008] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.820216] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.820254] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.820343] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78f53cda-281e-4098-b286-926afd0b084e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.821352] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea4050e2-26be-4e7b-8e45-6c0b0a8a5e08 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.821352] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea4050e2-26be-4e7b-8e45-6c0b0a8a5e08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.821506] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea4050e2-26be-4e7b-8e45-6c0b0a8a5e08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.821553] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea4050e2-26be-4e7b-8e45-6c0b0a8a5e08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.821606] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea4050e2-26be-4e7b-8e45-6c0b0a8a5e08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.891180] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.891180] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.891180] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.891180] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.891180] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.907849] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9b127ff-135f-4cd2-9456-bc11d98737ce in Status: IN_PROGRESS for 2s [ 655.317402] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e550f237-9e27-45ea-9e02-516ac8d2852f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.325481] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78f53cda-281e-4098-b286-926afd0b084e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.327171] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-78f53cda-281e-4098-b286-926afd0b084e taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.327171] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78f53cda-281e-4098-b286-926afd0b084e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.327171] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ea4050e2-26be-4e7b-8e45-6c0b0a8a5e08 with status ACTIVE [ 655.327171] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.327171] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.327171] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.327498] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.327498] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.330956] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.330956] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.330956] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.330956] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.330956] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.330956] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.330956] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.330956] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.330956] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.330956] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.330956] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ea4050e2-26be-4e7b-8e45-6c0b0a8a5e08 is going to be updated. [ 655.352231] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.352231] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.352231] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.352231] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.352231] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.352231] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea4050e2-26be-4e7b-8e45-6c0b0a8a5e08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.820514] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.820935] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.820935] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.821158] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.821238] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.821342] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e550f237-9e27-45ea-9e02-516ac8d2852f is going to be updated. [ 655.830713] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78f53cda-281e-4098-b286-926afd0b084e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.864542] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.864763] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.864894] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.865329] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.865697] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.877846] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e550f237-9e27-45ea-9e02-516ac8d2852f in Status: IN_PROGRESS for 2s [ 656.333687] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.334139] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.334318] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.334675] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.334850] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.335010] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78f53cda-281e-4098-b286-926afd0b084e is going to be created. [ 656.374738] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.375038] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.375135] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.375469] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.375699] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.388081] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78f53cda-281e-4098-b286-926afd0b084e in Status: UNINITIALIZED for 2s [ 656.925246] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9b127ff-135f-4cd2-9456-bc11d98737ce in Status: SUCCESS [ 656.925570] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.893209] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e550f237-9e27-45ea-9e02-516ac8d2852f in Status: SUCCESS [ 657.893441] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.893938] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.894858] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.894858] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.894858] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.894858] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.894858] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.894858] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.894858] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.895220] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e550f237-9e27-45ea-9e02-516ac8d2852f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.399915] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e550f237-9e27-45ea-9e02-516ac8d2852f taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.399915] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.399915] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.399915] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.400400] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.400400] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.400400] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.400400] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.400400] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.400579] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.400681] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e550f237-9e27-45ea-9e02-516ac8d2852f taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.400761] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.400817] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.400976] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.401145] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.401248] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.404056] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.404056] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.404056] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.404056] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.404056] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e550f237-9e27-45ea-9e02-516ac8d2852f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.404056] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78f53cda-281e-4098-b286-926afd0b084e in Status: SUCCESS [ 658.404056] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78f53cda-281e-4098-b286-926afd0b084e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.404056] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78f53cda-281e-4098-b286-926afd0b084e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.404428] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78f53cda-281e-4098-b286-926afd0b084e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.404428] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.404514] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.404548] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.404672] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.404749] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.404840] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78f53cda-281e-4098-b286-926afd0b084e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.404954] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78f53cda-281e-4098-b286-926afd0b084e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.907575] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e550f237-9e27-45ea-9e02-516ac8d2852f: rpc.has_security_group_logging(os_id): False [ 658.909130] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-78f53cda-281e-4098-b286-926afd0b084e taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.909315] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78f53cda-281e-4098-b286-926afd0b084e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.909369] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78f53cda-281e-4098-b286-926afd0b084e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.909563] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78f53cda-281e-4098-b286-926afd0b084e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.909723] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.909824] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.910243] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.910243] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.910393] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.910393] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78f53cda-281e-4098-b286-926afd0b084e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.910499] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-78f53cda-281e-4098-b286-926afd0b084e taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.910590] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78f53cda-281e-4098-b286-926afd0b084e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.910651] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78f53cda-281e-4098-b286-926afd0b084e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.910804] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78f53cda-281e-4098-b286-926afd0b084e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.911100] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.911254] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.911330] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.911498] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.911600] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.911699] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78f53cda-281e-4098-b286-926afd0b084e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.911793] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78f53cda-281e-4098-b286-926afd0b084e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.936737] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.936917] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.936960] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.937546] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.937747] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.937956] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.938046] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.938602] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.938602] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.938602] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.938602] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.938852] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.938852] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.938917] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.939081] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.939263] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.939352] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.939410] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.939573] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.939622] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.939702] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e550f237-9e27-45ea-9e02-516ac8d2852f is going to be updated. [ 659.012656] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.012802] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.012849] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.013102] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.013299] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.031643] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e550f237-9e27-45ea-9e02-516ac8d2852f in Status: IN_PROGRESS for 2s [ 659.416078] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78f53cda-281e-4098-b286-926afd0b084e: rpc.has_security_group_logging(os_id): False [ 659.448540] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.448707] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.448777] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.451019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.451019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.451019] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.451019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.451019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.451019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.451019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.451019] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.451019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.451742] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.451742] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.451742] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.451742] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.451742] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.451742] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.451956] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.451956] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.452035] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78f53cda-281e-4098-b286-926afd0b084e is going to be created. [ 659.525344] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.525579] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.525579] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.525838] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.526059] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.539829] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78f53cda-281e-4098-b286-926afd0b084e in Status: IN_PROGRESS for 2s [ 659.819283] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 659.819389] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 660.522284] env[65943]: INFO networking_nsxv3.common.synchronization [req-6f8c6341-ea96-44bb-8dd4-bb5fce8d1533 req-2d6bfaf0-2d28-4a9d-bbb3-288a1e5975a6 tempest-InstanceActionsV221TestJSON-1819449024 tempest-InstanceActionsV221TestJSON-1819449024-project-member] Enqueued Resource ID: 4d778131-5833-4ecf-9479-3c14db301ff2 with Priority: HIGHEST for action security_group_members [ 660.522813] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d778131-5833-4ecf-9479-3c14db301ff2 with Priority: HIGHEST for action security_group_members [ 660.523272] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d778131-5833-4ecf-9479-3c14db301ff2 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.524483] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d778131-5833-4ecf-9479-3c14db301ff2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.524483] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d778131-5833-4ecf-9479-3c14db301ff2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.524483] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d778131-5833-4ecf-9479-3c14db301ff2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.524483] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.524483] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.524483] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.524743] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.524779] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.524925] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d778131-5833-4ecf-9479-3c14db301ff2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.027401] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.027687] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.027687] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.027851] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.027965] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.028183] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.028287] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.028364] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.028503] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.028581] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.028664] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d778131-5833-4ecf-9479-3c14db301ff2 is going to be updated. [ 661.048886] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e550f237-9e27-45ea-9e02-516ac8d2852f in Status: SUCCESS [ 661.049304] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.064937] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.065181] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.065251] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.065499] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.065670] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.077839] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d778131-5833-4ecf-9479-3c14db301ff2 in Status: IN_PROGRESS for 2s [ 661.559077] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78f53cda-281e-4098-b286-926afd0b084e in Status: SUCCESS [ 661.559077] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78f53cda-281e-4098-b286-926afd0b084e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.709904] env[65943]: INFO networking_nsxv3.common.synchronization [None req-a4d17e25-4839-4510-bf08-643c71f17dd1 None None] Enqueued Resource ID: b91b71bb-6df6-4c9e-8210-45cf2e9f8f55 with Priority: HIGHEST for action port [ 661.710666] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b91b71bb-6df6-4c9e-8210-45cf2e9f8f55 with Priority: HIGHEST for action port [ 661.711239] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-b91b71bb-6df6-4c9e-8210-45cf2e9f8f55 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.711444] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b91b71bb-6df6-4c9e-8210-45cf2e9f8f55" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.711590] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b91b71bb-6df6-4c9e-8210-45cf2e9f8f55" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.712251] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b91b71bb-6df6-4c9e-8210-45cf2e9f8f55" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.712251] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b91b71bb-6df6-4c9e-8210-45cf2e9f8f55',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.214849] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b91b71bb-6df6-4c9e-8210-45cf2e9f8f55 [ 662.217143] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.217143] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.217143] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.217143] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.217143] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.217143] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b91b71bb-6df6-4c9e-8210-45cf2e9f8f55 already deleted. [ 662.217143] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b91b71bb-6df6-4c9e-8210-45cf2e9f8f55" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.094655] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d778131-5833-4ecf-9479-3c14db301ff2 in Status: SUCCESS [ 663.094655] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d778131-5833-4ecf-9479-3c14db301ff2 deletion is rescheduled due to dependency. [ 663.094655] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d778131-5833-4ecf-9479-3c14db301ff2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.784465] env[65943]: INFO networking_nsxv3.common.synchronization [None req-eef25761-7e98-4489-abef-aaf7866df512 None None] Enqueued Resource ID: 4a85baa1-0967-4c24-8e6e-87ed3ead3e1c with Priority: HIGHEST for action port [ 663.784465] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a85baa1-0967-4c24-8e6e-87ed3ead3e1c with Priority: HIGHEST for action port [ 663.784894] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a85baa1-0967-4c24-8e6e-87ed3ead3e1c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.785082] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a85baa1-0967-4c24-8e6e-87ed3ead3e1c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.785161] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a85baa1-0967-4c24-8e6e-87ed3ead3e1c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.785433] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a85baa1-0967-4c24-8e6e-87ed3ead3e1c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.785557] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a85baa1-0967-4c24-8e6e-87ed3ead3e1c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.287340] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4a85baa1-0967-4c24-8e6e-87ed3ead3e1c [ 664.287692] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.287778] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.287829] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.288099] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.288201] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.288286] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4a85baa1-0967-4c24-8e6e-87ed3ead3e1c already deleted. [ 664.288366] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a85baa1-0967-4c24-8e6e-87ed3ead3e1c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.243227] env[65943]: INFO networking_nsxv3.common.synchronization [req-86f99ec8-20e4-4528-a85f-67a8cd79b040 req-94d6c943-6bf5-487d-bf67-8aad8ee2f64e tempest-ServersAdminTestJSON-910281195 tempest-ServersAdminTestJSON-910281195-project-member] Enqueued Resource ID: e02be8c7-70b1-4488-b079-b1ebf20a733c with Priority: HIGHEST for action security_group_members [ 665.243227] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e02be8c7-70b1-4488-b079-b1ebf20a733c with Priority: HIGHEST for action security_group_members [ 665.243227] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e02be8c7-70b1-4488-b079-b1ebf20a733c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.243394] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.243394] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.244179] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.244277] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.244482] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.244482] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.244630] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.244798] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.246180] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.748735] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.767390] env[65943]: INFO networking_nsxv3.common.synchronization [None req-7be2f38d-e02f-4ea3-97da-b96e16e9cf4b tempest-ServersTestFqdnHostnames-900375028 tempest-ServersTestFqdnHostnames-900375028-project-member] Enqueued Resource ID: bad8ffbf-a375-4ee1-b522-c5e84af1b840 with Priority: HIGHEST for action security_group_rules [ 665.769774] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bad8ffbf-a375-4ee1-b522-c5e84af1b840 with Priority: HIGHEST for action security_group_rules [ 665.769774] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bad8ffbf-a375-4ee1-b522-c5e84af1b840 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.769774] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bad8ffbf-a375-4ee1-b522-c5e84af1b840" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.769774] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bad8ffbf-a375-4ee1-b522-c5e84af1b840" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.770297] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bad8ffbf-a375-4ee1-b522-c5e84af1b840" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.770387] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bad8ffbf-a375-4ee1-b522-c5e84af1b840',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.903237] env[65943]: INFO networking_nsxv3.common.synchronization [None req-1de7ba3c-7540-4153-a2d5-4baecbbf8e14 tempest-ServersTestFqdnHostnames-900375028 tempest-ServersTestFqdnHostnames-900375028-project-member] Enqueued Resource ID: bad8ffbf-a375-4ee1-b522-c5e84af1b840 with Priority: HIGHEST for action security_group_rules [ 665.904637] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bad8ffbf-a375-4ee1-b522-c5e84af1b840 with Priority: HIGHEST for action security_group_rules [ 665.904637] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bad8ffbf-a375-4ee1-b522-c5e84af1b840 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.904637] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bad8ffbf-a375-4ee1-b522-c5e84af1b840" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.252822] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.299235] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.299437] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.299437] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.299665] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.299761] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.299854] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bad8ffbf-a375-4ee1-b522-c5e84af1b840 already deleted. [ 666.299938] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bad8ffbf-a375-4ee1-b522-c5e84af1b840" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.300101] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bad8ffbf-a375-4ee1-b522-c5e84af1b840" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.300257] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bad8ffbf-a375-4ee1-b522-c5e84af1b840" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.300340] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bad8ffbf-a375-4ee1-b522-c5e84af1b840',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.757094] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.757434] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.757434] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.758197] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.758197] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.758197] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e02be8c7-70b1-4488-b079-b1ebf20a733c is going to be updated. [ 666.793281] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.793576] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.793824] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.794017] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.794180] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.806474] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e02be8c7-70b1-4488-b079-b1ebf20a733c in Status: IN_PROGRESS for 2s [ 666.820707] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.820858] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.821043] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.821321] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.823240] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.824263] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bad8ffbf-a375-4ee1-b522-c5e84af1b840 already deleted. [ 666.824263] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bad8ffbf-a375-4ee1-b522-c5e84af1b840" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.848865] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-581 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.848865] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-581" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.848865] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-581" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.850465] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-581" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.850465] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.850465] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.851183] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.851305] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.851481] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.851689] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 666.851788] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 666.851900] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 666.851999] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 666.852325] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 666.852325] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 666.852439] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 666.879509] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 666.879737] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 666.880573] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 666.880684] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-581" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.881102] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-14b0488b-d8c0-44fa-91e2-d16f1f622d38 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.881319] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-14b0488b-d8c0-44fa-91e2-d16f1f622d38" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.881452] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-14b0488b-d8c0-44fa-91e2-d16f1f622d38" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.881923] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-14b0488b-d8c0-44fa-91e2-d16f1f622d38" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.881923] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14b0488b-d8c0-44fa-91e2-d16f1f622d38',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.058764] env[65943]: INFO networking_nsxv3.common.synchronization [None req-5d6532fb-edb0-4a09-9ee0-70111e47b6ed None None] Enqueued Resource ID: de8f2f4e-dae5-4579-8613-01005a91d3fc with Priority: HIGHEST for action port [ 667.059983] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de8f2f4e-dae5-4579-8613-01005a91d3fc with Priority: HIGHEST for action port [ 667.059983] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-de8f2f4e-dae5-4579-8613-01005a91d3fc taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.059983] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de8f2f4e-dae5-4579-8613-01005a91d3fc" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.060162] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de8f2f4e-dae5-4579-8613-01005a91d3fc" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.060851] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de8f2f4e-dae5-4579-8613-01005a91d3fc" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.060963] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de8f2f4e-dae5-4579-8613-01005a91d3fc',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.384520] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.384799] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.384947] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.385282] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.386102] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.386102] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port 14b0488b-d8c0-44fa-91e2-d16f1f622d38 not found, creating... [ 667.386102] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.386284] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.386391] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.386589] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.386749] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.388461] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.388626] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.388732] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.388968] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.389143] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.389289] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: 14b0488b-d8c0-44fa-91e2-d16f1f622d38 is going to be created. [ 667.410717] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.410717] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.410717] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.410717] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.414913] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.414913] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-14b0488b-d8c0-44fa-91e2-d16f1f622d38" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.565527] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de8f2f4e-dae5-4579-8613-01005a91d3fc [ 667.565844] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.565984] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.566070] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.566295] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.566388] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.566484] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de8f2f4e-dae5-4579-8613-01005a91d3fc already deleted. [ 667.566612] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de8f2f4e-dae5-4579-8613-01005a91d3fc" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.221755] env[65943]: INFO networking_nsxv3.common.synchronization [req-86f99ec8-20e4-4528-a85f-67a8cd79b040 req-543ae21a-ab54-4820-a664-2ba518bbaf6f service nova] Enqueued Resource ID: e02be8c7-70b1-4488-b079-b1ebf20a733c with Priority: HIGHEST for action security_group_rules [ 668.221755] env[65943]: INFO networking_nsxv3.common.synchronization [req-86f99ec8-20e4-4528-a85f-67a8cd79b040 req-543ae21a-ab54-4820-a664-2ba518bbaf6f service nova] Enqueued Resource ID: e02be8c7-70b1-4488-b079-b1ebf20a733c with Priority: HIGHEST for action security_group_members [ 668.221755] env[65943]: INFO networking_nsxv3.common.synchronization [req-86f99ec8-20e4-4528-a85f-67a8cd79b040 req-543ae21a-ab54-4820-a664-2ba518bbaf6f service nova] Enqueued Resource ID: 14b0488b-d8c0-44fa-91e2-d16f1f622d38 with Priority: HIGHEST for action port [ 668.222244] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e02be8c7-70b1-4488-b079-b1ebf20a733c with Priority: HIGHEST for action security_group_rules [ 668.222244] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e02be8c7-70b1-4488-b079-b1ebf20a733c with Priority: HIGHEST for action security_group_members [ 668.222852] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14b0488b-d8c0-44fa-91e2-d16f1f622d38 with Priority: HIGHEST for action port [ 668.223302] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e02be8c7-70b1-4488-b079-b1ebf20a733c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.223501] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.223635] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.223918] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.224446] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.226144] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e02be8c7-70b1-4488-b079-b1ebf20a733c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.226620] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.226970] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-14b0488b-d8c0-44fa-91e2-d16f1f622d38 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.227216] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14b0488b-d8c0-44fa-91e2-d16f1f622d38" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.227327] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14b0488b-d8c0-44fa-91e2-d16f1f622d38" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.227881] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14b0488b-d8c0-44fa-91e2-d16f1f622d38" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.227945] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14b0488b-d8c0-44fa-91e2-d16f1f622d38',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.312624] env[65943]: INFO networking_nsxv3.common.synchronization [req-b3337530-61cc-470b-960a-513d9195806c req-5febf8a1-3abf-4127-b0cb-842278343d12 tempest-VolumesAdminNegativeTest-1398229337 tempest-VolumesAdminNegativeTest-1398229337-project-member] Enqueued Resource ID: 9539d191-87a5-4727-b693-a846f1e6f855 with Priority: HIGHEST for action security_group_members [ 668.313410] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9539d191-87a5-4727-b693-a846f1e6f855 with Priority: HIGHEST for action security_group_members [ 668.313767] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-9539d191-87a5-4727-b693-a846f1e6f855 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.313894] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9539d191-87a5-4727-b693-a846f1e6f855" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.314187] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9539d191-87a5-4727-b693-a846f1e6f855" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.314601] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9539d191-87a5-4727-b693-a846f1e6f855" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.314823] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.314987] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.315107] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.315350] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.315483] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.315661] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9539d191-87a5-4727-b693-a846f1e6f855',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.702881] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-24 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.702881] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.702881] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.702881] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.702881] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.703295] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.703295] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.703409] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.703677] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.703886] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 668.704009] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 668.704121] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 668.704227] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 668.704333] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 668.704434] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 668.704564] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 668.731966] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 668.731966] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 668.731966] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 668.731966] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.731966] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-54e2a5c9-c915-46f1-b264-b24000c5d3e4 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.731966] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-54e2a5c9-c915-46f1-b264-b24000c5d3e4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.731966] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-54e2a5c9-c915-46f1-b264-b24000c5d3e4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.731966] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-54e2a5c9-c915-46f1-b264-b24000c5d3e4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.731966] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54e2a5c9-c915-46f1-b264-b24000c5d3e4',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.733432] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e02be8c7-70b1-4488-b079-b1ebf20a733c taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.733432] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.733432] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 14b0488b-d8c0-44fa-91e2-d16f1f622d38 with status ACTIVE [ 668.733432] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.734030] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.734030] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.734030] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.734030] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.734238] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.734352] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.734418] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.734625] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.734713] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.735157] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.735234] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.735284] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.735437] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.735668] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.735668] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 14b0488b-d8c0-44fa-91e2-d16f1f622d38 is going to be updated. [ 668.764199] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.764362] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.764362] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.764588] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.764731] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.764917] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14b0488b-d8c0-44fa-91e2-d16f1f622d38" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.818230] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e02be8c7-70b1-4488-b079-b1ebf20a733c in Status: SUCCESS [ 668.818501] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.818830] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.818945] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.819020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.819238] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.819710] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.819919] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.820042] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.820108] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.820272] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.820350] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.820434] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9539d191-87a5-4727-b693-a846f1e6f855 already deleted. [ 668.820513] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9539d191-87a5-4727-b693-a846f1e6f855" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.820982] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.821163] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.821311] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.821408] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.821470] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.821616] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.821716] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.821811] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.947219] env[65943]: INFO networking_nsxv3.common.synchronization [None req-dadb53d6-c12e-463f-b145-90badfedffd2 None None] Enqueued Resource ID: 23f03202-c17b-4322-83b8-c67fcd9525e2 with Priority: HIGHEST for action port [ 668.947727] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23f03202-c17b-4322-83b8-c67fcd9525e2 with Priority: HIGHEST for action port [ 668.948032] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-23f03202-c17b-4322-83b8-c67fcd9525e2 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.948153] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23f03202-c17b-4322-83b8-c67fcd9525e2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.948219] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23f03202-c17b-4322-83b8-c67fcd9525e2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.948462] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23f03202-c17b-4322-83b8-c67fcd9525e2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.948543] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23f03202-c17b-4322-83b8-c67fcd9525e2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.238294] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.238594] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.238658] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.238882] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.239035] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.239181] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port 54e2a5c9-c915-46f1-b264-b24000c5d3e4 not found, creating... [ 669.239428] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.239770] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.239842] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.240072] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.240223] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.240468] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.240608] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.240717] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.240921] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.241066] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.241403] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: 54e2a5c9-c915-46f1-b264-b24000c5d3e4 is going to be created. [ 669.264295] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.264396] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.264466] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.264815] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.265205] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.265426] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-54e2a5c9-c915-46f1-b264-b24000c5d3e4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.325166] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.450467] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 23f03202-c17b-4322-83b8-c67fcd9525e2 [ 669.450759] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.450947] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.451044] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.451437] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.451536] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.451639] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:23f03202-c17b-4322-83b8-c67fcd9525e2 already deleted. [ 669.451716] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23f03202-c17b-4322-83b8-c67fcd9525e2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.827763] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.031281] env[65943]: INFO networking_nsxv3.common.synchronization [req-b3337530-61cc-470b-960a-513d9195806c req-79e5be04-7314-4452-aeee-06630a5a35a9 service nova] Enqueued Resource ID: 9539d191-87a5-4727-b693-a846f1e6f855 with Priority: HIGHEST for action security_group_rules [ 670.031449] env[65943]: INFO networking_nsxv3.common.synchronization [req-b3337530-61cc-470b-960a-513d9195806c req-79e5be04-7314-4452-aeee-06630a5a35a9 service nova] Enqueued Resource ID: 9539d191-87a5-4727-b693-a846f1e6f855 with Priority: HIGHEST for action security_group_members [ 670.031579] env[65943]: INFO networking_nsxv3.common.synchronization [req-b3337530-61cc-470b-960a-513d9195806c req-79e5be04-7314-4452-aeee-06630a5a35a9 service nova] Enqueued Resource ID: 54e2a5c9-c915-46f1-b264-b24000c5d3e4 with Priority: HIGHEST for action port [ 670.032153] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9539d191-87a5-4727-b693-a846f1e6f855 with Priority: HIGHEST for action security_group_rules [ 670.032270] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9539d191-87a5-4727-b693-a846f1e6f855 with Priority: HIGHEST for action security_group_members [ 670.032374] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54e2a5c9-c915-46f1-b264-b24000c5d3e4 with Priority: HIGHEST for action port [ 670.033014] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9539d191-87a5-4727-b693-a846f1e6f855 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.033014] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9539d191-87a5-4727-b693-a846f1e6f855" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.033014] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9539d191-87a5-4727-b693-a846f1e6f855" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.033277] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9539d191-87a5-4727-b693-a846f1e6f855" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.033411] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9539d191-87a5-4727-b693-a846f1e6f855',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.034220] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-9539d191-87a5-4727-b693-a846f1e6f855 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.034320] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9539d191-87a5-4727-b693-a846f1e6f855" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.034398] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9539d191-87a5-4727-b693-a846f1e6f855" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.034549] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9539d191-87a5-4727-b693-a846f1e6f855" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.034736] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.035067] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.035067] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.035067] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.035320] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.035320] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9539d191-87a5-4727-b693-a846f1e6f855',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.035954] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-54e2a5c9-c915-46f1-b264-b24000c5d3e4 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.036124] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54e2a5c9-c915-46f1-b264-b24000c5d3e4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.036124] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54e2a5c9-c915-46f1-b264-b24000c5d3e4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.036331] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54e2a5c9-c915-46f1-b264-b24000c5d3e4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.036387] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54e2a5c9-c915-46f1-b264-b24000c5d3e4',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.334028] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.334028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.334028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.334426] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.334464] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.334608] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e02be8c7-70b1-4488-b079-b1ebf20a733c is going to be updated. [ 670.375038] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.375038] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.375318] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.375318] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.375991] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.392593] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e02be8c7-70b1-4488-b079-b1ebf20a733c in Status: IN_PROGRESS for 2s [ 670.538107] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-9539d191-87a5-4727-b693-a846f1e6f855 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.538260] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9539d191-87a5-4727-b693-a846f1e6f855" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.538471] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 54e2a5c9-c915-46f1-b264-b24000c5d3e4 with status ACTIVE [ 670.538708] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.538773] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.538819] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.539060] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.539107] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.539300] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.539384] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.539424] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.539575] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.539627] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.539827] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.539946] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.540027] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.540175] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.540939] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.540939] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 54e2a5c9-c915-46f1-b264-b24000c5d3e4 is going to be updated. [ 670.541658] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9539d191-87a5-4727-b693-a846f1e6f855',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.566682] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.566682] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.566682] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.566986] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.567047] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.567322] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54e2a5c9-c915-46f1-b264-b24000c5d3e4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.044443] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9539d191-87a5-4727-b693-a846f1e6f855',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.547106] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.547423] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.547423] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.547731] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.547829] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.548102] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9539d191-87a5-4727-b693-a846f1e6f855 is going to be created. [ 671.575775] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.575998] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.576089] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.576294] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.576518] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.590662] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9539d191-87a5-4727-b693-a846f1e6f855 in Status: UNINITIALIZED for 2s [ 671.655742] env[65943]: INFO networking_nsxv3.common.synchronization [req-2b2e67cd-7d24-43f6-ad20-d1dd595b0fae req-b4f7f901-cd0d-46ec-8f42-44f2c63c085e tempest-AttachInterfacesTestJSON-882476571 tempest-AttachInterfacesTestJSON-882476571-project-member] Enqueued Resource ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 with Priority: HIGHEST for action security_group_members [ 671.656732] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 with Priority: HIGHEST for action security_group_members [ 671.657013] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8a054b-6bee-465e-84da-d50dfdc27f64 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.657131] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.657245] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.657546] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.657752] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.657915] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.658041] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.658261] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.658401] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.658572] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.030183] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-916 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.030436] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-916" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.030513] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-916" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.030838] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-916" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.031445] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.031641] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.031641] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.031967] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.032211] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.032468] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 672.032615] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 672.032687] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 672.032784] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 672.032893] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 672.032994] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 672.033155] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 672.053182] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 672.053346] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 672.053468] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 672.053751] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-916" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.054083] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-30b0f8b4-985a-4e4a-842a-32b6e13872e2 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.054256] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-30b0f8b4-985a-4e4a-842a-32b6e13872e2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.054368] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-30b0f8b4-985a-4e4a-842a-32b6e13872e2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.054695] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-30b0f8b4-985a-4e4a-842a-32b6e13872e2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.054877] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30b0f8b4-985a-4e4a-842a-32b6e13872e2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.164985] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.164985] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.164985] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.164985] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.164985] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.164985] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.164985] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.164985] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.164985] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.164985] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.164985] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 already deleted. [ 672.164985] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.404893] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e02be8c7-70b1-4488-b079-b1ebf20a733c in Status: SUCCESS [ 672.405263] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.405737] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.406030] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.406242] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.406390] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.406498] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.406649] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.406758] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.406800] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.407469] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.561548] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.561548] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.561548] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.561548] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.561548] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.561548] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port 30b0f8b4-985a-4e4a-842a-32b6e13872e2 not found, creating... [ 672.561548] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.561548] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.561548] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.561548] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.561548] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.562221] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.562923] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.564421] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.564421] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.564421] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.564421] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: 30b0f8b4-985a-4e4a-842a-32b6e13872e2 is going to be created. [ 672.586563] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.586832] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.587131] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.587488] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.588162] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.589276] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-30b0f8b4-985a-4e4a-842a-32b6e13872e2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.910091] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e02be8c7-70b1-4488-b079-b1ebf20a733c taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.910091] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.910091] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.910306] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.910554] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.910720] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.911587] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.911587] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.911587] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.911587] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.911835] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e02be8c7-70b1-4488-b079-b1ebf20a733c taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.911835] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.911925] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.912125] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.912357] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.912493] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.912581] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.912789] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.912910] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.913202] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.913202] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.973341] env[65943]: INFO networking_nsxv3.common.synchronization [req-84e76449-238e-4a84-bb07-b10d3102b7eb req-8bf0ed86-d391-428b-8891-e394abb77e90 tempest-ImagesTestJSON-196343566 tempest-ImagesTestJSON-196343566-project-member] Enqueued Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_members [ 672.974154] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_members [ 672.974951] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c81f5e-9888-4914-ab90-42d06116db49 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.974951] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.974951] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.974951] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.975243] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.975308] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.975344] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.975473] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.975554] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.975721] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.337314] env[65943]: INFO networking_nsxv3.common.synchronization [req-2b2e67cd-7d24-43f6-ad20-d1dd595b0fae req-8db91d86-37a3-4d61-b80b-2e2b9605544c service nova] Enqueued Resource ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 with Priority: HIGHEST for action security_group_rules [ 673.337525] env[65943]: INFO networking_nsxv3.common.synchronization [req-2b2e67cd-7d24-43f6-ad20-d1dd595b0fae req-8db91d86-37a3-4d61-b80b-2e2b9605544c service nova] Enqueued Resource ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 with Priority: HIGHEST for action security_group_members [ 673.337622] env[65943]: INFO networking_nsxv3.common.synchronization [req-2b2e67cd-7d24-43f6-ad20-d1dd595b0fae req-8db91d86-37a3-4d61-b80b-2e2b9605544c service nova] Enqueued Resource ID: 30b0f8b4-985a-4e4a-842a-32b6e13872e2 with Priority: HIGHEST for action port [ 673.338157] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 with Priority: HIGHEST for action security_group_rules [ 673.338371] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 with Priority: HIGHEST for action security_group_members [ 673.338506] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b0f8b4-985a-4e4a-842a-32b6e13872e2 with Priority: HIGHEST for action port [ 673.338830] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c8a054b-6bee-465e-84da-d50dfdc27f64 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.338931] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.338981] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.339297] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.339385] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.340327] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8a054b-6bee-465e-84da-d50dfdc27f64 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.340327] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.340427] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.340566] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.340718] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.340816] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.340876] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.341048] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.341149] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.341332] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.342562] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-30b0f8b4-985a-4e4a-842a-32b6e13872e2 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.342562] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30b0f8b4-985a-4e4a-842a-32b6e13872e2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.342562] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30b0f8b4-985a-4e4a-842a-32b6e13872e2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.342562] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30b0f8b4-985a-4e4a-842a-32b6e13872e2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.342562] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30b0f8b4-985a-4e4a-842a-32b6e13872e2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.415635] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e02be8c7-70b1-4488-b079-b1ebf20a733c: rpc.has_security_group_logging(os_id): False [ 673.434600] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.434600] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.434600] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.436420] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.436420] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.436420] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.436420] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.436420] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.436420] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.436420] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.436420] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.436420] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.436420] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.436420] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.436420] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.436869] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.436869] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.436869] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.436869] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.437020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.437288] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e02be8c7-70b1-4488-b079-b1ebf20a733c is going to be updated. [ 673.479561] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.479768] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.479768] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.480015] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.480122] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.480311] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.480405] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.480464] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.480622] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.480699] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.480770] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c81f5e-9888-4914-ab90-42d06116db49 already deleted. [ 673.480854] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.499903] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.500167] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.500167] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.500408] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.500471] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.516536] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e02be8c7-70b1-4488-b079-b1ebf20a733c in Status: IN_PROGRESS for 2s [ 673.600994] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9539d191-87a5-4727-b693-a846f1e6f855 in Status: SUCCESS [ 673.604199] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9539d191-87a5-4727-b693-a846f1e6f855" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.604199] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9539d191-87a5-4727-b693-a846f1e6f855" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.604199] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9539d191-87a5-4727-b693-a846f1e6f855" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.604199] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.604199] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.604199] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.604199] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.604199] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.604199] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9539d191-87a5-4727-b693-a846f1e6f855" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.604199] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9539d191-87a5-4727-b693-a846f1e6f855',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.625573] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-40 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.625573] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-40" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.625573] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-40" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.626027] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-40" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.626436] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.626778] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.627064] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.627469] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.627839] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.629026] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 673.629026] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 673.629026] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 673.629026] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 673.629026] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 673.629026] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 673.629026] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 673.650646] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 673.650953] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 673.651478] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 673.651478] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-40" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.652095] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-25a6af89-1aa1-4eed-9b8b-a03b7896181d taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.652456] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-25a6af89-1aa1-4eed-9b8b-a03b7896181d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.652650] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-25a6af89-1aa1-4eed-9b8b-a03b7896181d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.653091] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-25a6af89-1aa1-4eed-9b8b-a03b7896181d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.653295] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25a6af89-1aa1-4eed-9b8b-a03b7896181d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.844307] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.845455] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8a054b-6bee-465e-84da-d50dfdc27f64 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.845575] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.846040] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 30b0f8b4-985a-4e4a-842a-32b6e13872e2 with status ACTIVE [ 673.846222] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.846350] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.846417] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.846604] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.846742] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.846850] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.846941] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.846994] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.847162] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.847236] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.847411] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.847508] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.847628] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.847687] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.847763] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.847854] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 30b0f8b4-985a-4e4a-842a-32b6e13872e2 is going to be updated. [ 673.873585] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.873906] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.873906] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.874043] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.874166] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.874327] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30b0f8b4-985a-4e4a-842a-32b6e13872e2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.109965] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-9539d191-87a5-4727-b693-a846f1e6f855 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.109965] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9539d191-87a5-4727-b693-a846f1e6f855" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.109965] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9539d191-87a5-4727-b693-a846f1e6f855" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.109965] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9539d191-87a5-4727-b693-a846f1e6f855" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.109965] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.109965] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.109965] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.109965] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.109965] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.109965] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9539d191-87a5-4727-b693-a846f1e6f855" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.109965] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-9539d191-87a5-4727-b693-a846f1e6f855 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.109965] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9539d191-87a5-4727-b693-a846f1e6f855" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.109965] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9539d191-87a5-4727-b693-a846f1e6f855" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.109965] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9539d191-87a5-4727-b693-a846f1e6f855" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.109965] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.110732] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.110732] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.110732] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.110732] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.110732] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9539d191-87a5-4727-b693-a846f1e6f855" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.110732] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9539d191-87a5-4727-b693-a846f1e6f855',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.156692] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.156692] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.156909] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.157366] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.157366] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.157488] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port 25a6af89-1aa1-4eed-9b8b-a03b7896181d not found, creating... [ 674.157726] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.157902] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.158034] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.158297] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.158460] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.158749] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.158901] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.159049] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.159271] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.159398] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.159544] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: 25a6af89-1aa1-4eed-9b8b-a03b7896181d is going to be created. [ 674.179596] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.179825] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.179931] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.180260] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.180489] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.180707] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-25a6af89-1aa1-4eed-9b8b-a03b7896181d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.346346] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.612667] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9539d191-87a5-4727-b693-a846f1e6f855: rpc.has_security_group_logging(os_id): False [ 674.633328] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.633519] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.633569] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.633776] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.633859] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.634102] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.634205] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.634260] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.634416] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.634492] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.634669] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.634763] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.634822] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.635013] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.635209] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.635428] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.635828] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.636040] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.636107] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.636148] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.636393] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9539d191-87a5-4727-b693-a846f1e6f855 is going to be created. [ 674.729539] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.729539] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.729846] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.729846] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.730025] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.745413] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9539d191-87a5-4727-b693-a846f1e6f855 in Status: IN_PROGRESS for 2s [ 674.848505] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.848744] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.848744] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.848950] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.849061] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.849164] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 is going to be created. [ 674.896238] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.896238] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.896238] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.896238] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.896238] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.919277] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 in Status: UNINITIALIZED for 2s [ 675.340555] env[65943]: INFO networking_nsxv3.common.synchronization [req-84e76449-238e-4a84-bb07-b10d3102b7eb req-64253df6-9d07-4f24-860f-d78f00a57f3b service nova] Enqueued Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_rules [ 675.340768] env[65943]: INFO networking_nsxv3.common.synchronization [req-84e76449-238e-4a84-bb07-b10d3102b7eb req-64253df6-9d07-4f24-860f-d78f00a57f3b service nova] Enqueued Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_members [ 675.340926] env[65943]: INFO networking_nsxv3.common.synchronization [req-84e76449-238e-4a84-bb07-b10d3102b7eb req-64253df6-9d07-4f24-860f-d78f00a57f3b service nova] Enqueued Resource ID: 25a6af89-1aa1-4eed-9b8b-a03b7896181d with Priority: HIGHEST for action port [ 675.343887] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_rules [ 675.347706] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_members [ 675.347884] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25a6af89-1aa1-4eed-9b8b-a03b7896181d with Priority: HIGHEST for action port [ 675.348439] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0c81f5e-9888-4914-ab90-42d06116db49 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.348439] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.348439] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.349066] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.349933] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.351589] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c81f5e-9888-4914-ab90-42d06116db49 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.351589] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.351589] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.351589] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.351880] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.351880] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.351880] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.352015] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.352053] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.353337] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.354479] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-25a6af89-1aa1-4eed-9b8b-a03b7896181d taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.354629] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25a6af89-1aa1-4eed-9b8b-a03b7896181d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.354902] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25a6af89-1aa1-4eed-9b8b-a03b7896181d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.355121] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25a6af89-1aa1-4eed-9b8b-a03b7896181d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.355193] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25a6af89-1aa1-4eed-9b8b-a03b7896181d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.533332] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e02be8c7-70b1-4488-b079-b1ebf20a733c in Status: SUCCESS [ 675.533332] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.851673] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c81f5e-9888-4914-ab90-42d06116db49 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.852128] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.855597] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.860526] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 25a6af89-1aa1-4eed-9b8b-a03b7896181d with status ACTIVE [ 675.860526] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.860526] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.860526] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.860526] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.860526] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.860526] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.860526] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.860526] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.860526] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.860526] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.860526] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.860526] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.860526] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.860526] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.860526] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.860526] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 25a6af89-1aa1-4eed-9b8b-a03b7896181d is going to be updated. [ 675.887969] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.888189] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.888237] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.888465] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.888642] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.888892] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25a6af89-1aa1-4eed-9b8b-a03b7896181d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.251443] env[65943]: INFO networking_nsxv3.common.synchronization [None req-65e367d1-7796-4734-abbe-39f4317e1eb0 None None] Enqueued Resource ID: 83c6c165-cc0d-43e6-855f-7989a43aa90f with Priority: HIGHEST for action port [ 676.252951] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83c6c165-cc0d-43e6-855f-7989a43aa90f with Priority: HIGHEST for action port [ 676.255022] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-83c6c165-cc0d-43e6-855f-7989a43aa90f taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.256134] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83c6c165-cc0d-43e6-855f-7989a43aa90f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.256134] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83c6c165-cc0d-43e6-855f-7989a43aa90f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.256134] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83c6c165-cc0d-43e6-855f-7989a43aa90f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.256134] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83c6c165-cc0d-43e6-855f-7989a43aa90f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.358509] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.759661] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 83c6c165-cc0d-43e6-855f-7989a43aa90f [ 676.759998] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.760811] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.760811] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.760811] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.760811] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.760811] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:83c6c165-cc0d-43e6-855f-7989a43aa90f already deleted. [ 676.760811] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83c6c165-cc0d-43e6-855f-7989a43aa90f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.763802] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9539d191-87a5-4727-b693-a846f1e6f855 in Status: SUCCESS [ 676.764203] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9539d191-87a5-4727-b693-a846f1e6f855" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.863355] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.863665] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.863665] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.864510] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.864510] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.864510] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c81f5e-9888-4914-ab90-42d06116db49 is going to be created. [ 676.888314] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.888498] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.888544] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.888785] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.888912] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.901061] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c81f5e-9888-4914-ab90-42d06116db49 in Status: UNINITIALIZED for 2s [ 676.944821] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 in Status: SUCCESS [ 676.946948] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.946948] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.946948] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.946948] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.946948] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.946948] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.947344] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.947426] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.947563] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.947715] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.451516] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8a054b-6bee-465e-84da-d50dfdc27f64 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.452627] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.452627] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.452627] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.452627] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.452627] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.452627] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.452627] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.452627] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.452627] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.453115] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8a054b-6bee-465e-84da-d50dfdc27f64 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.453115] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.453115] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.453115] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.453258] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.453258] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.453380] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.453524] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.453524] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.453612] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.453696] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.956456] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c8a054b-6bee-465e-84da-d50dfdc27f64: rpc.has_security_group_logging(os_id): False [ 677.981882] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.982126] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.982788] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.982788] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.982788] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.983109] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.983203] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.983260] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.983919] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.983919] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.983919] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.983919] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.983919] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.984251] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.984251] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.984357] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.984357] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.984459] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.984541] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.984620] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.984737] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 is going to be created. [ 678.094765] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.094970] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.095058] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.095267] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.095460] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.110062] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 in Status: IN_PROGRESS for 2s [ 678.913541] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c81f5e-9888-4914-ab90-42d06116db49 in Status: SUCCESS [ 678.913719] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.913881] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.914159] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.914360] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.914481] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.914545] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.914760] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.914860] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.914906] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.915012] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.939917] env[65943]: INFO networking_nsxv3.common.synchronization [None req-341c4893-ae92-4b91-8e9b-f2c1c2002144 None None] Enqueued Resource ID: 3ef29edf-398a-4980-9113-07fec3f227f4 with Priority: HIGHEST for action port [ 678.940700] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ef29edf-398a-4980-9113-07fec3f227f4 with Priority: HIGHEST for action port [ 678.940986] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ef29edf-398a-4980-9113-07fec3f227f4 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.942552] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ef29edf-398a-4980-9113-07fec3f227f4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.943036] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ef29edf-398a-4980-9113-07fec3f227f4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.943359] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ef29edf-398a-4980-9113-07fec3f227f4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.943489] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ef29edf-398a-4980-9113-07fec3f227f4',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.120398] env[65943]: INFO networking_nsxv3.common.synchronization [None req-8b0040ea-8338-401e-a42e-247a4db6b99d tempest-ServerActionsTestOtherA-92071881 tempest-ServerActionsTestOtherA-92071881-project-member] Enqueued Resource ID: 3e3d8b17-4394-4674-b793-075706514abb with Priority: HIGHEST for action security_group_rules [ 679.121393] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3d8b17-4394-4674-b793-075706514abb with Priority: HIGHEST for action security_group_rules [ 679.121885] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e3d8b17-4394-4674-b793-075706514abb taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.122538] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.122538] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.122791] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.122956] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e3d8b17-4394-4674-b793-075706514abb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.417384] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c81f5e-9888-4914-ab90-42d06116db49 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.417708] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.417708] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.418033] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.418584] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.418584] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.418584] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.418837] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.418949] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.419070] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.419304] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c81f5e-9888-4914-ab90-42d06116db49 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.419379] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.419449] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.419647] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.419800] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.419895] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.419955] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.420113] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.420191] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.420274] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.420364] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.445662] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3ef29edf-398a-4980-9113-07fec3f227f4 [ 679.446049] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.446254] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.446354] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.446609] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.446746] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.446895] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3ef29edf-398a-4980-9113-07fec3f227f4 already deleted. [ 679.447016] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ef29edf-398a-4980-9113-07fec3f227f4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.451851] env[65943]: INFO networking_nsxv3.common.synchronization [req-d7ddbac6-64bc-4810-a4a1-3a9a3b28297f req-0823085a-efbc-4adc-9854-98e29ac3db26 tempest-DeleteServersAdminTestJSON-941821739 tempest-DeleteServersAdminTestJSON-941821739-project-member] Enqueued Resource ID: e550f237-9e27-45ea-9e02-516ac8d2852f with Priority: HIGHEST for action security_group_members [ 679.452589] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e550f237-9e27-45ea-9e02-516ac8d2852f with Priority: HIGHEST for action security_group_members [ 679.453297] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e550f237-9e27-45ea-9e02-516ac8d2852f taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.454108] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.454108] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.454301] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.454520] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.454790] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.454935] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.455722] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.456338] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.456474] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e550f237-9e27-45ea-9e02-516ac8d2852f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.471087] env[65943]: INFO networking_nsxv3.common.synchronization [None req-e0d7ff83-1819-43b2-ba48-46bde7df8880 tempest-ServerActionsTestOtherA-92071881 tempest-ServerActionsTestOtherA-92071881-project-member] Enqueued Resource ID: 3e3d8b17-4394-4674-b793-075706514abb with Priority: HIGHEST for action security_group_rules [ 679.474552] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3d8b17-4394-4674-b793-075706514abb with Priority: HIGHEST for action security_group_rules [ 679.474552] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e3d8b17-4394-4674-b793-075706514abb taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.474552] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.702511] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.702511] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.702511] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.702511] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.702511] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.702511] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e3d8b17-4394-4674-b793-075706514abb already deleted. [ 679.702511] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.702511] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.702511] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.702511] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e3d8b17-4394-4674-b793-075706514abb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.925230] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0c81f5e-9888-4914-ab90-42d06116db49: rpc.has_security_group_logging(os_id): False [ 679.945203] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.945787] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.945787] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.945787] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.945787] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.946082] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.946082] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.946245] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.946318] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.946379] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.946568] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.946750] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.946750] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.946861] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.946915] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.947082] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.947198] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.947258] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.947358] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.947426] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.947508] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0c81f5e-9888-4914-ab90-42d06116db49 is going to be created. [ 679.959415] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.959634] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.959634] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.959990] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.959990] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.960262] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.960262] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.960262] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.960420] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.960420] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.960556] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e550f237-9e27-45ea-9e02-516ac8d2852f is going to be updated. [ 679.995106] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.995407] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.995407] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.995658] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.995894] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.006326] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e550f237-9e27-45ea-9e02-516ac8d2852f in Status: IN_PROGRESS for 2s [ 680.024592] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.024752] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.024752] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.024961] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.025251] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.038840] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0c81f5e-9888-4914-ab90-42d06116db49 in Status: IN_PROGRESS for 2s [ 680.130027] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 in Status: SUCCESS [ 680.130525] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.232224] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.232224] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.232224] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.233468] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.233468] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.233468] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e3d8b17-4394-4674-b793-075706514abb already deleted. [ 680.233468] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.073761] env[65943]: INFO networking_nsxv3.common.synchronization [None req-c82b39e8-9bec-4e61-8b0c-8801d3dc043a None None] Enqueued Resource ID: 1019aa80-d9d1-40ca-af96-03fc0b8f0129 with Priority: HIGHEST for action port [ 681.077055] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1019aa80-d9d1-40ca-af96-03fc0b8f0129 with Priority: HIGHEST for action port [ 681.077055] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-1019aa80-d9d1-40ca-af96-03fc0b8f0129 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.077055] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1019aa80-d9d1-40ca-af96-03fc0b8f0129" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.077055] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1019aa80-d9d1-40ca-af96-03fc0b8f0129" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.077055] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1019aa80-d9d1-40ca-af96-03fc0b8f0129" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.077055] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1019aa80-d9d1-40ca-af96-03fc0b8f0129',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.155033] env[65943]: INFO networking_nsxv3.common.synchronization [req-df5ab912-d3b5-4136-bd82-38ec3c51486a req-76ec9175-8974-4106-a038-5d8613c90c23 tempest-FloatingIPsAssociationNegativeTestJSON-67475887 tempest-FloatingIPsAssociationNegativeTestJSON-67475887-project-member] Enqueued Resource ID: bf5449c8-e110-49bf-b5ea-dcfeefaf5d48 with Priority: HIGHEST for action security_group_members [ 681.156186] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf5449c8-e110-49bf-b5ea-dcfeefaf5d48 with Priority: HIGHEST for action security_group_members [ 681.157176] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.157377] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.157476] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.157902] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.158667] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.158667] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.158908] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.159306] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.160066] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.160066] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf5449c8-e110-49bf-b5ea-dcfeefaf5d48',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.581266] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1019aa80-d9d1-40ca-af96-03fc0b8f0129 [ 681.581582] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.581772] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.581873] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.582373] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.584174] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.584174] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1019aa80-d9d1-40ca-af96-03fc0b8f0129 already deleted. [ 681.584174] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1019aa80-d9d1-40ca-af96-03fc0b8f0129" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.665269] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.665404] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.665519] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.665828] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.665999] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.666407] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.668157] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.668157] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.668157] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.668157] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.668157] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf5449c8-e110-49bf-b5ea-dcfeefaf5d48 is going to be updated. [ 681.712669] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.713814] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.713935] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.714144] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.714337] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.729447] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf5449c8-e110-49bf-b5ea-dcfeefaf5d48 in Status: IN_PROGRESS for 2s [ 681.818418] env[65943]: INFO networking_nsxv3.common.synchronization [req-1ac0de29-85a5-423c-a5dc-22bab73a243a req-a6f17c15-c800-4616-ad46-0e5f67aec9a0 tempest-FloatingIPsAssociationTestJSON-462341531 tempest-FloatingIPsAssociationTestJSON-462341531-project-member] Enqueued Resource ID: 9a29bac0-8e63-4f6f-957d-9bd116500c7e with Priority: HIGHEST for action security_group_members [ 681.818585] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a29bac0-8e63-4f6f-957d-9bd116500c7e with Priority: HIGHEST for action security_group_members [ 681.818913] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a29bac0-8e63-4f6f-957d-9bd116500c7e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.819077] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.819156] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.819430] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.819590] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.819686] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.819745] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.819950] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.820079] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.820199] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a29bac0-8e63-4f6f-957d-9bd116500c7e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.022359] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e550f237-9e27-45ea-9e02-516ac8d2852f in Status: SUCCESS [ 682.022466] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e550f237-9e27-45ea-9e02-516ac8d2852f deletion is rescheduled due to dependency. [ 682.022681] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.052390] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0c81f5e-9888-4914-ab90-42d06116db49 in Status: SUCCESS [ 682.054048] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.323905] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.324256] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.324256] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.325433] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.325433] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.325433] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.325433] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.325433] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.325433] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.325433] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.325433] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a29bac0-8e63-4f6f-957d-9bd116500c7e already deleted. [ 682.325433] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.381357] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-334 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.381539] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-334" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.381774] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-334" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.383134] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-334" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.383134] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.383134] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.383134] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.383400] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.383808] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.383808] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 682.383951] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 682.384294] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 682.384294] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 682.384294] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 682.384438] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 682.384438] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 682.405574] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 682.405812] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 682.405930] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 682.406142] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-334" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.406460] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-8a6d6ed1-9e0a-4df6-b6e0-5d4318cc3562 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.406629] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-8a6d6ed1-9e0a-4df6-b6e0-5d4318cc3562" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.406755] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-8a6d6ed1-9e0a-4df6-b6e0-5d4318cc3562" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.407085] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-8a6d6ed1-9e0a-4df6-b6e0-5d4318cc3562" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.407217] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a6d6ed1-9e0a-4df6-b6e0-5d4318cc3562',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.910057] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.911026] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.911026] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.911026] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.911026] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.911270] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port 8a6d6ed1-9e0a-4df6-b6e0-5d4318cc3562 not found, creating... [ 682.911438] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.911589] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.911696] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.911959] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.912879] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.912879] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.912879] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.912879] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.913167] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.913167] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.913243] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: 8a6d6ed1-9e0a-4df6-b6e0-5d4318cc3562 is going to be created. [ 682.934503] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.934705] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.934810] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.935137] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.935388] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.935567] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-8a6d6ed1-9e0a-4df6-b6e0-5d4318cc3562" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.706020] env[65943]: INFO networking_nsxv3.common.synchronization [req-1ac0de29-85a5-423c-a5dc-22bab73a243a req-90c4f982-f72b-4d83-9206-bce2919b808e service nova] Enqueued Resource ID: 9a29bac0-8e63-4f6f-957d-9bd116500c7e with Priority: HIGHEST for action security_group_rules [ 683.706020] env[65943]: INFO networking_nsxv3.common.synchronization [req-1ac0de29-85a5-423c-a5dc-22bab73a243a req-90c4f982-f72b-4d83-9206-bce2919b808e service nova] Enqueued Resource ID: 9a29bac0-8e63-4f6f-957d-9bd116500c7e with Priority: HIGHEST for action security_group_members [ 683.706020] env[65943]: INFO networking_nsxv3.common.synchronization [req-1ac0de29-85a5-423c-a5dc-22bab73a243a req-90c4f982-f72b-4d83-9206-bce2919b808e service nova] Enqueued Resource ID: 8a6d6ed1-9e0a-4df6-b6e0-5d4318cc3562 with Priority: HIGHEST for action port [ 683.706819] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a29bac0-8e63-4f6f-957d-9bd116500c7e with Priority: HIGHEST for action security_group_rules [ 683.710101] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a29bac0-8e63-4f6f-957d-9bd116500c7e with Priority: HIGHEST for action security_group_members [ 683.710101] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a6d6ed1-9e0a-4df6-b6e0-5d4318cc3562 with Priority: HIGHEST for action port [ 683.710101] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a29bac0-8e63-4f6f-957d-9bd116500c7e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.710101] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.710101] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.710101] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.710101] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a29bac0-8e63-4f6f-957d-9bd116500c7e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.710101] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a29bac0-8e63-4f6f-957d-9bd116500c7e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.710101] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.710101] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.710101] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.710101] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.710101] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.710101] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.710101] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.710101] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.710101] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a29bac0-8e63-4f6f-957d-9bd116500c7e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.713449] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a6d6ed1-9e0a-4df6-b6e0-5d4318cc3562 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.714058] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a6d6ed1-9e0a-4df6-b6e0-5d4318cc3562" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.714258] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a6d6ed1-9e0a-4df6-b6e0-5d4318cc3562" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.714553] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a6d6ed1-9e0a-4df6-b6e0-5d4318cc3562" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.714734] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a6d6ed1-9e0a-4df6-b6e0-5d4318cc3562',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.744558] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf5449c8-e110-49bf-b5ea-dcfeefaf5d48 in Status: SUCCESS [ 683.745216] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf5449c8-e110-49bf-b5ea-dcfeefaf5d48 deletion is rescheduled due to dependency. [ 683.745216] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.070625] env[65943]: INFO networking_nsxv3.common.synchronization [None req-6b8508e6-d52d-475b-a2e2-2d4b8be6d6c1 None None] Enqueued Resource ID: d5f14d7c-eedb-49cb-a6b3-fb2cadb4ba9f with Priority: HIGHEST for action port [ 684.070625] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5f14d7c-eedb-49cb-a6b3-fb2cadb4ba9f with Priority: HIGHEST for action port [ 684.070625] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5f14d7c-eedb-49cb-a6b3-fb2cadb4ba9f taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.070625] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5f14d7c-eedb-49cb-a6b3-fb2cadb4ba9f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.070625] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5f14d7c-eedb-49cb-a6b3-fb2cadb4ba9f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.070625] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5f14d7c-eedb-49cb-a6b3-fb2cadb4ba9f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.070625] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5f14d7c-eedb-49cb-a6b3-fb2cadb4ba9f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.213349] env[65943]: INFO networking_nsxv3.common.synchronization [None req-9bafb40e-15e7-43a2-994b-7c778f3b23a1 None None] Enqueued Resource ID: a8838976-d9f2-428d-a4c9-26315370d724 with Priority: HIGHEST for action port [ 684.213908] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8838976-d9f2-428d-a4c9-26315370d724 with Priority: HIGHEST for action port [ 684.214789] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8838976-d9f2-428d-a4c9-26315370d724 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.214789] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8838976-d9f2-428d-a4c9-26315370d724" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.214789] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8838976-d9f2-428d-a4c9-26315370d724" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.214789] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8838976-d9f2-428d-a4c9-26315370d724" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.214789] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8838976-d9f2-428d-a4c9-26315370d724',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.217038] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8a6d6ed1-9e0a-4df6-b6e0-5d4318cc3562 with status ACTIVE [ 684.218172] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.219240] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.219240] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.219240] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.219240] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.219240] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.219536] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.219934] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.219934] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.219934] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.220323] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.220403] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.220563] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.220808] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.220900] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.221022] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8a6d6ed1-9e0a-4df6-b6e0-5d4318cc3562 is going to be updated. [ 684.222669] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a29bac0-8e63-4f6f-957d-9bd116500c7e taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.222669] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.223195] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a29bac0-8e63-4f6f-957d-9bd116500c7e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.249365] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.249365] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.249600] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.249637] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.250538] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.250538] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a6d6ed1-9e0a-4df6-b6e0-5d4318cc3562" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.573511] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d5f14d7c-eedb-49cb-a6b3-fb2cadb4ba9f [ 684.573726] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.573852] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.573916] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.574506] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.574506] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.574506] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d5f14d7c-eedb-49cb-a6b3-fb2cadb4ba9f already deleted. [ 684.574506] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5f14d7c-eedb-49cb-a6b3-fb2cadb4ba9f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.719674] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a8838976-d9f2-428d-a4c9-26315370d724 [ 684.719674] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.719674] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.719674] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.719674] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.719674] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.719674] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a8838976-d9f2-428d-a4c9-26315370d724 already deleted. [ 684.719674] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8838976-d9f2-428d-a4c9-26315370d724" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.726175] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a29bac0-8e63-4f6f-957d-9bd116500c7e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.867760] env[65943]: INFO networking_nsxv3.common.synchronization [req-b9aedc38-66e7-4713-bca7-885892e1c4d1 req-b84cc907-ca74-448b-aedd-80902e6720cd tempest-ServerDiagnosticsTest-441166188 tempest-ServerDiagnosticsTest-441166188-project-member] Enqueued Resource ID: 82c62f05-41a4-43fb-a74d-0baaee3b8043 with Priority: HIGHEST for action security_group_members [ 684.869008] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82c62f05-41a4-43fb-a74d-0baaee3b8043 with Priority: HIGHEST for action security_group_members [ 684.869160] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-82c62f05-41a4-43fb-a74d-0baaee3b8043 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.870083] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82c62f05-41a4-43fb-a74d-0baaee3b8043" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.870083] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82c62f05-41a4-43fb-a74d-0baaee3b8043" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.870083] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82c62f05-41a4-43fb-a74d-0baaee3b8043" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.870083] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.870083] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.870083] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.870083] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.870437] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.870437] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82c62f05-41a4-43fb-a74d-0baaee3b8043',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.229298] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.229502] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.229549] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.229763] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.229874] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.229977] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a29bac0-8e63-4f6f-957d-9bd116500c7e is going to be created. [ 685.260398] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.260661] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.260661] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.260833] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.261060] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.273173] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a29bac0-8e63-4f6f-957d-9bd116500c7e in Status: UNINITIALIZED for 2s [ 685.373409] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.373724] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.373724] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.374062] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.374062] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.374177] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.374737] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.374737] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.374737] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.374737] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.374737] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82c62f05-41a4-43fb-a74d-0baaee3b8043 already deleted. [ 685.374737] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82c62f05-41a4-43fb-a74d-0baaee3b8043" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.438754] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-651 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.439776] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.439776] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.439776] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.439776] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.439776] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.440114] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.440114] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.440189] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.440402] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 685.440462] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 685.440974] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 685.440974] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 685.440974] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 685.440974] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 685.441191] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 685.462112] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 685.462112] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 685.462112] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 685.462112] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.462112] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-546a3250-424b-48a5-9fa8-9999f4135dea taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.462112] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-546a3250-424b-48a5-9fa8-9999f4135dea" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.462441] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-546a3250-424b-48a5-9fa8-9999f4135dea" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.462597] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-546a3250-424b-48a5-9fa8-9999f4135dea" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.462666] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('546a3250-424b-48a5-9fa8-9999f4135dea',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.966020] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.966424] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.966424] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.966698] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.966806] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.966973] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port 546a3250-424b-48a5-9fa8-9999f4135dea not found, creating... [ 685.967280] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.967464] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.967639] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.967872] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.968037] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.968340] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.968487] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.968595] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.968801] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.968928] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.969195] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: 546a3250-424b-48a5-9fa8-9999f4135dea is going to be created. [ 685.992327] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.992565] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.992693] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.992967] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.993273] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.993611] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-546a3250-424b-48a5-9fa8-9999f4135dea" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.525444] env[65943]: INFO networking_nsxv3.common.synchronization [None req-0168eff6-dfbb-4a38-b2d7-f894b5f21d0f None None] Enqueued Resource ID: c693b98f-adb0-47fd-882f-4cfeccd72a79 with Priority: HIGHEST for action port [ 686.526508] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c693b98f-adb0-47fd-882f-4cfeccd72a79 with Priority: HIGHEST for action port [ 686.527316] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-c693b98f-adb0-47fd-882f-4cfeccd72a79 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.527509] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c693b98f-adb0-47fd-882f-4cfeccd72a79" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.527625] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c693b98f-adb0-47fd-882f-4cfeccd72a79" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.528090] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c693b98f-adb0-47fd-882f-4cfeccd72a79" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.528263] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c693b98f-adb0-47fd-882f-4cfeccd72a79',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.704035] env[65943]: INFO networking_nsxv3.common.synchronization [req-b9aedc38-66e7-4713-bca7-885892e1c4d1 req-14600630-0e2e-4d6a-bd62-c078ac7e4656 service nova] Enqueued Resource ID: 82c62f05-41a4-43fb-a74d-0baaee3b8043 with Priority: HIGHEST for action security_group_rules [ 686.704249] env[65943]: INFO networking_nsxv3.common.synchronization [req-b9aedc38-66e7-4713-bca7-885892e1c4d1 req-14600630-0e2e-4d6a-bd62-c078ac7e4656 service nova] Enqueued Resource ID: 82c62f05-41a4-43fb-a74d-0baaee3b8043 with Priority: HIGHEST for action security_group_members [ 686.704521] env[65943]: INFO networking_nsxv3.common.synchronization [req-b9aedc38-66e7-4713-bca7-885892e1c4d1 req-14600630-0e2e-4d6a-bd62-c078ac7e4656 service nova] Enqueued Resource ID: 546a3250-424b-48a5-9fa8-9999f4135dea with Priority: HIGHEST for action port [ 686.709077] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82c62f05-41a4-43fb-a74d-0baaee3b8043 with Priority: HIGHEST for action security_group_rules [ 686.709347] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82c62f05-41a4-43fb-a74d-0baaee3b8043 with Priority: HIGHEST for action security_group_members [ 686.709459] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 546a3250-424b-48a5-9fa8-9999f4135dea with Priority: HIGHEST for action port [ 686.710269] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-82c62f05-41a4-43fb-a74d-0baaee3b8043 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.710476] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-82c62f05-41a4-43fb-a74d-0baaee3b8043" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.710476] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-82c62f05-41a4-43fb-a74d-0baaee3b8043" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.710759] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-82c62f05-41a4-43fb-a74d-0baaee3b8043" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.710840] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('82c62f05-41a4-43fb-a74d-0baaee3b8043',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.717652] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-82c62f05-41a4-43fb-a74d-0baaee3b8043 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.717652] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82c62f05-41a4-43fb-a74d-0baaee3b8043" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.717652] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82c62f05-41a4-43fb-a74d-0baaee3b8043" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.717652] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82c62f05-41a4-43fb-a74d-0baaee3b8043" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.717652] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.717652] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.717652] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.718279] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.718279] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.718279] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82c62f05-41a4-43fb-a74d-0baaee3b8043',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.719410] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-546a3250-424b-48a5-9fa8-9999f4135dea taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.720382] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-546a3250-424b-48a5-9fa8-9999f4135dea" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.720382] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-546a3250-424b-48a5-9fa8-9999f4135dea" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.720382] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-546a3250-424b-48a5-9fa8-9999f4135dea" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.720382] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('546a3250-424b-48a5-9fa8-9999f4135dea',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.031527] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c693b98f-adb0-47fd-882f-4cfeccd72a79 [ 687.032978] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.032978] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.032978] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.032978] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.032978] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.032978] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c693b98f-adb0-47fd-882f-4cfeccd72a79 already deleted. [ 687.032978] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c693b98f-adb0-47fd-882f-4cfeccd72a79" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.215600] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-82c62f05-41a4-43fb-a74d-0baaee3b8043 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.215600] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82c62f05-41a4-43fb-a74d-0baaee3b8043" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.222893] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('82c62f05-41a4-43fb-a74d-0baaee3b8043',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.227174] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 546a3250-424b-48a5-9fa8-9999f4135dea with status ACTIVE [ 687.229017] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.229017] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.229017] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.229017] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.229017] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.229017] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.229017] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.229017] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.229017] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.229017] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.229017] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.229017] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.229017] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.229017] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.229017] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.229017] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 546a3250-424b-48a5-9fa8-9999f4135dea is going to be updated. [ 687.252904] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.253083] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.253156] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.253364] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.253504] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.253662] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-546a3250-424b-48a5-9fa8-9999f4135dea" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.282694] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a29bac0-8e63-4f6f-957d-9bd116500c7e in Status: SUCCESS [ 687.282872] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.283050] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.283272] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.283470] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.283570] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.283638] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.283788] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.283888] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.283985] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.284087] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9a29bac0-8e63-4f6f-957d-9bd116500c7e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.476418] env[65943]: INFO networking_nsxv3.common.synchronization [req-2799c85b-c9f8-4747-a255-cb2aefb9cd8b req-f17311bc-b1ab-40aa-9309-b55f2ff3aca6 tempest-ServersTestFqdnHostnames-900375028 tempest-ServersTestFqdnHostnames-900375028-project-member] Enqueued Resource ID: bad8ffbf-a375-4ee1-b522-c5e84af1b840 with Priority: HIGHEST for action security_group_members [ 687.477245] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bad8ffbf-a375-4ee1-b522-c5e84af1b840 with Priority: HIGHEST for action security_group_members [ 687.477364] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-bad8ffbf-a375-4ee1-b522-c5e84af1b840 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.477446] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bad8ffbf-a375-4ee1-b522-c5e84af1b840" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.478467] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bad8ffbf-a375-4ee1-b522-c5e84af1b840" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.478467] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bad8ffbf-a375-4ee1-b522-c5e84af1b840" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.478467] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.478467] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.478467] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.478467] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.478467] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.478467] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bad8ffbf-a375-4ee1-b522-c5e84af1b840',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.726056] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('82c62f05-41a4-43fb-a74d-0baaee3b8043',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.793452] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a29bac0-8e63-4f6f-957d-9bd116500c7e taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.793452] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.793452] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.793452] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.793452] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.793452] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.793452] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.793452] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.793452] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.793452] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.793452] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a29bac0-8e63-4f6f-957d-9bd116500c7e taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.793452] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.793452] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.793452] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.793452] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.793452] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.794409] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.794409] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.794409] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.794409] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.794409] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9a29bac0-8e63-4f6f-957d-9bd116500c7e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.981618] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.981618] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.981618] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.981618] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.981618] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.981933] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.981933] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.981933] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.983297] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.983353] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.983468] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bad8ffbf-a375-4ee1-b522-c5e84af1b840 already deleted. [ 687.983517] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bad8ffbf-a375-4ee1-b522-c5e84af1b840" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.007886] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-550 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.008097] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-550" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.008713] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-550" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.009325] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-550" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.010412] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.010789] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.010954] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.011178] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.011371] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.011501] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 688.011604] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 688.011711] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 688.011806] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 688.011905] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 688.011998] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 688.012139] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 688.035575] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 688.036154] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 688.036154] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 688.036154] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-550" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.036458] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-3da3cc9f-f669-47ce-8d07-2a43a4511359 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.036603] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-3da3cc9f-f669-47ce-8d07-2a43a4511359" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.036713] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-3da3cc9f-f669-47ce-8d07-2a43a4511359" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.037182] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-3da3cc9f-f669-47ce-8d07-2a43a4511359" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.037362] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3da3cc9f-f669-47ce-8d07-2a43a4511359',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.229778] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.230123] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.230232] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.230541] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.230653] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.230776] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82c62f05-41a4-43fb-a74d-0baaee3b8043 is going to be created. [ 688.263642] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.263838] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.263887] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.264278] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.264414] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.276416] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82c62f05-41a4-43fb-a74d-0baaee3b8043 in Status: UNINITIALIZED for 2s [ 688.295368] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9a29bac0-8e63-4f6f-957d-9bd116500c7e: rpc.has_security_group_logging(os_id): False [ 688.333218] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.333449] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.334041] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.334041] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.334041] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.334432] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.334432] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.334532] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.334753] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.334842] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.335053] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.335176] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.335239] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.335525] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.335663] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.336015] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.336149] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.336245] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.336440] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.336523] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.336614] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a29bac0-8e63-4f6f-957d-9bd116500c7e is going to be created. [ 688.400966] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.401261] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.401411] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.401666] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.401944] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.425920] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a29bac0-8e63-4f6f-957d-9bd116500c7e in Status: IN_PROGRESS for 2s [ 688.543584] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.543775] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.543896] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.544300] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.544347] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.544487] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port 3da3cc9f-f669-47ce-8d07-2a43a4511359 not found, creating... [ 688.544736] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.544905] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.545078] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.545327] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.545421] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.545703] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.545873] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.545986] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.546383] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.546571] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.546646] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: 3da3cc9f-f669-47ce-8d07-2a43a4511359 is going to be created. [ 688.594038] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.594038] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.594038] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.594038] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.594038] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.594038] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-3da3cc9f-f669-47ce-8d07-2a43a4511359" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.503708] env[65943]: INFO networking_nsxv3.common.synchronization [req-2799c85b-c9f8-4747-a255-cb2aefb9cd8b req-f5984e7c-0a71-4917-8965-6049591c46f4 service nova] Enqueued Resource ID: bad8ffbf-a375-4ee1-b522-c5e84af1b840 with Priority: HIGHEST for action security_group_rules [ 689.504053] env[65943]: INFO networking_nsxv3.common.synchronization [req-2799c85b-c9f8-4747-a255-cb2aefb9cd8b req-f5984e7c-0a71-4917-8965-6049591c46f4 service nova] Enqueued Resource ID: bad8ffbf-a375-4ee1-b522-c5e84af1b840 with Priority: HIGHEST for action security_group_members [ 689.504141] env[65943]: INFO networking_nsxv3.common.synchronization [req-2799c85b-c9f8-4747-a255-cb2aefb9cd8b req-f5984e7c-0a71-4917-8965-6049591c46f4 service nova] Enqueued Resource ID: 3da3cc9f-f669-47ce-8d07-2a43a4511359 with Priority: HIGHEST for action port [ 689.504695] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bad8ffbf-a375-4ee1-b522-c5e84af1b840 with Priority: HIGHEST for action security_group_rules [ 689.505562] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bad8ffbf-a375-4ee1-b522-c5e84af1b840 with Priority: HIGHEST for action security_group_members [ 689.506079] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3da3cc9f-f669-47ce-8d07-2a43a4511359 with Priority: HIGHEST for action port [ 689.506297] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bad8ffbf-a375-4ee1-b522-c5e84af1b840 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.506496] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bad8ffbf-a375-4ee1-b522-c5e84af1b840" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.506552] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bad8ffbf-a375-4ee1-b522-c5e84af1b840" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.506890] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bad8ffbf-a375-4ee1-b522-c5e84af1b840" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.507015] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bad8ffbf-a375-4ee1-b522-c5e84af1b840',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.508329] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-bad8ffbf-a375-4ee1-b522-c5e84af1b840 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.508692] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bad8ffbf-a375-4ee1-b522-c5e84af1b840" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.508692] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bad8ffbf-a375-4ee1-b522-c5e84af1b840" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.508692] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bad8ffbf-a375-4ee1-b522-c5e84af1b840" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.508853] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.509016] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.509016] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.509135] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.509271] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.509331] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bad8ffbf-a375-4ee1-b522-c5e84af1b840',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.510204] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-3da3cc9f-f669-47ce-8d07-2a43a4511359 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.510309] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3da3cc9f-f669-47ce-8d07-2a43a4511359" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.510629] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3da3cc9f-f669-47ce-8d07-2a43a4511359" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.510629] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3da3cc9f-f669-47ce-8d07-2a43a4511359" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.510629] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3da3cc9f-f669-47ce-8d07-2a43a4511359',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.943213] env[65943]: INFO networking_nsxv3.common.synchronization [req-acd8bd5a-f181-4864-b84c-951956a9d74b req-199b21b9-ef18-42a4-9013-a535b41285cb tempest-ServerActionsV293TestJSON-838257534 tempest-ServerActionsV293TestJSON-838257534-project-member] Enqueued Resource ID: a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 with Priority: HIGHEST for action security_group_members [ 689.944132] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 with Priority: HIGHEST for action security_group_members [ 689.945017] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.945278] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.945348] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.945615] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.945862] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.946176] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.946176] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.946315] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.946841] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.946841] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4f83bf4-ed34-4088-a422-46a4d9e5c7e1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.015387] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-bad8ffbf-a375-4ee1-b522-c5e84af1b840 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.015387] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bad8ffbf-a375-4ee1-b522-c5e84af1b840" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.015387] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bad8ffbf-a375-4ee1-b522-c5e84af1b840',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.015567] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3da3cc9f-f669-47ce-8d07-2a43a4511359 with status ACTIVE [ 690.016422] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.017410] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.017410] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.017410] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.017410] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.017410] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.017920] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.018112] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.018362] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.018480] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.018710] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.018812] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.018876] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.019110] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.019446] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.019446] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3da3cc9f-f669-47ce-8d07-2a43a4511359 is going to be updated. [ 690.044933] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.045148] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.045212] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.045390] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.047989] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.047989] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3da3cc9f-f669-47ce-8d07-2a43a4511359" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.287692] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82c62f05-41a4-43fb-a74d-0baaee3b8043 in Status: SUCCESS [ 690.287938] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82c62f05-41a4-43fb-a74d-0baaee3b8043" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.288156] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82c62f05-41a4-43fb-a74d-0baaee3b8043" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.288384] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82c62f05-41a4-43fb-a74d-0baaee3b8043" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.288577] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.288689] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.288748] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.288904] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.288974] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.289849] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82c62f05-41a4-43fb-a74d-0baaee3b8043" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.289849] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('82c62f05-41a4-43fb-a74d-0baaee3b8043',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.417617] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-248 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.417824] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-248" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.417925] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-248" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.418599] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-248" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.419910] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.420111] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.420231] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.420485] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.420601] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.420901] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 690.421027] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 690.421134] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 690.421235] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 690.421339] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 690.421439] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 690.421562] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 690.440345] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a29bac0-8e63-4f6f-957d-9bd116500c7e in Status: SUCCESS [ 690.440575] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.444556] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 690.444784] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 690.445051] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 690.445051] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-248" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.445378] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-a355e043-fa0d-410a-9dbd-4966afb8e956 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.445592] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-a355e043-fa0d-410a-9dbd-4966afb8e956" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.445717] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-a355e043-fa0d-410a-9dbd-4966afb8e956" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.446024] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-a355e043-fa0d-410a-9dbd-4966afb8e956" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.446146] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a355e043-fa0d-410a-9dbd-4966afb8e956',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.449171] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.449308] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.449395] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.449724] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.449724] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.449954] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.449954] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.450114] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.450114] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.450269] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.450337] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 already deleted. [ 690.450389] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.522471] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bad8ffbf-a375-4ee1-b522-c5e84af1b840',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.685219] env[65943]: INFO networking_nsxv3.common.synchronization [req-3993ff06-d3f5-47ee-a2b6-bd627ef6c97b req-3ef15ee4-59ad-431e-8b4d-4fceae83949e tempest-ServersTestJSON-1580779679 tempest-ServersTestJSON-1580779679-project-member] Enqueued Resource ID: dcee84a2-5f8e-4aff-856c-81b817d31434 with Priority: HIGHEST for action security_group_members [ 690.685829] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcee84a2-5f8e-4aff-856c-81b817d31434 with Priority: HIGHEST for action security_group_members [ 690.686323] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcee84a2-5f8e-4aff-856c-81b817d31434 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.686453] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcee84a2-5f8e-4aff-856c-81b817d31434" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.686736] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcee84a2-5f8e-4aff-856c-81b817d31434" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.686736] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcee84a2-5f8e-4aff-856c-81b817d31434" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.690098] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.690098] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.690098] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.690098] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.690098] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.690098] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dcee84a2-5f8e-4aff-856c-81b817d31434',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.792270] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-82c62f05-41a4-43fb-a74d-0baaee3b8043 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.792449] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82c62f05-41a4-43fb-a74d-0baaee3b8043" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.792632] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82c62f05-41a4-43fb-a74d-0baaee3b8043" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.792753] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82c62f05-41a4-43fb-a74d-0baaee3b8043" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.792935] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.793048] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.793113] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.793299] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.793394] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.793595] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82c62f05-41a4-43fb-a74d-0baaee3b8043" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.793673] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-82c62f05-41a4-43fb-a74d-0baaee3b8043 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.793769] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82c62f05-41a4-43fb-a74d-0baaee3b8043" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.793813] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82c62f05-41a4-43fb-a74d-0baaee3b8043" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.794054] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82c62f05-41a4-43fb-a74d-0baaee3b8043" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.794146] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.794244] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.794335] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.794522] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.794622] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.794723] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82c62f05-41a4-43fb-a74d-0baaee3b8043" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.794863] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('82c62f05-41a4-43fb-a74d-0baaee3b8043',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.948713] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.948713] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.948713] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.948939] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.950029] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.950029] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port a355e043-fa0d-410a-9dbd-4966afb8e956 not found, creating... [ 690.950029] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.950029] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.950029] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.950346] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.950346] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.953244] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.953489] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.953489] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.953668] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.953837] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.953995] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: a355e043-fa0d-410a-9dbd-4966afb8e956 is going to be created. [ 690.979764] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.980317] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.980317] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.980424] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.980875] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.981209] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-a355e043-fa0d-410a-9dbd-4966afb8e956" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.025639] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.025848] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.025950] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.026266] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.026363] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.026468] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bad8ffbf-a375-4ee1-b522-c5e84af1b840 is going to be created. [ 691.068393] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.068555] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.068599] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.068806] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.069038] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.082682] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bad8ffbf-a375-4ee1-b522-c5e84af1b840 in Status: UNINITIALIZED for 2s [ 691.189719] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.189966] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.189966] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.190652] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.190796] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.191030] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.191229] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.191467] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.191753] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.191863] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.192130] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcee84a2-5f8e-4aff-856c-81b817d31434 is going to be updated. [ 691.224198] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.224396] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.224396] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.224642] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.224990] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.235963] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcee84a2-5f8e-4aff-856c-81b817d31434 in Status: IN_PROGRESS for 2s [ 691.298058] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 82c62f05-41a4-43fb-a74d-0baaee3b8043: rpc.has_security_group_logging(os_id): False [ 691.317420] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.317420] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.317605] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.317672] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.317786] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.318021] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.318291] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.318291] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.318402] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.318480] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.318684] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.318778] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.318838] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.319496] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.319496] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.319496] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.319496] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.319496] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.319917] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.319917] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.319917] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 82c62f05-41a4-43fb-a74d-0baaee3b8043 is going to be created. [ 691.389348] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.389528] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.389620] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.389814] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.390037] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.404108] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 82c62f05-41a4-43fb-a74d-0baaee3b8043 in Status: IN_PROGRESS for 2s [ 691.802070] env[65943]: INFO networking_nsxv3.common.synchronization [req-acd8bd5a-f181-4864-b84c-951956a9d74b req-a26f54cd-8a71-4aa5-87d2-78249d7119eb service nova] Enqueued Resource ID: a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 with Priority: HIGHEST for action security_group_rules [ 691.802070] env[65943]: INFO networking_nsxv3.common.synchronization [req-acd8bd5a-f181-4864-b84c-951956a9d74b req-a26f54cd-8a71-4aa5-87d2-78249d7119eb service nova] Enqueued Resource ID: a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 with Priority: HIGHEST for action security_group_members [ 691.802070] env[65943]: INFO networking_nsxv3.common.synchronization [req-acd8bd5a-f181-4864-b84c-951956a9d74b req-a26f54cd-8a71-4aa5-87d2-78249d7119eb service nova] Enqueued Resource ID: a355e043-fa0d-410a-9dbd-4966afb8e956 with Priority: HIGHEST for action port [ 691.808540] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 with Priority: HIGHEST for action security_group_rules [ 691.808540] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 with Priority: HIGHEST for action security_group_members [ 691.808540] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a355e043-fa0d-410a-9dbd-4966afb8e956 with Priority: HIGHEST for action port [ 691.808540] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.808540] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.808540] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.810340] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.810340] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4f83bf4-ed34-4088-a422-46a4d9e5c7e1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.812891] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.813545] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.813545] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.813545] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.813734] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.814114] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.814114] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.814264] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.814367] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.814471] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4f83bf4-ed34-4088-a422-46a4d9e5c7e1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.818327] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-a355e043-fa0d-410a-9dbd-4966afb8e956 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.818327] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a355e043-fa0d-410a-9dbd-4966afb8e956" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.818327] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a355e043-fa0d-410a-9dbd-4966afb8e956" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.818327] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a355e043-fa0d-410a-9dbd-4966afb8e956" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.818601] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a355e043-fa0d-410a-9dbd-4966afb8e956',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.321500] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.321500] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.323714] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a355e043-fa0d-410a-9dbd-4966afb8e956 with status ACTIVE [ 692.323985] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.324183] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.324296] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.324491] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.324605] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.324754] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.324940] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.324940] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.325150] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.325291] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.325424] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.325553] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.325586] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.325715] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.325835] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.325966] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a355e043-fa0d-410a-9dbd-4966afb8e956 is going to be updated. [ 692.327367] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4f83bf4-ed34-4088-a422-46a4d9e5c7e1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.353899] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.354196] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.354289] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.354452] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.355075] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.355075] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a355e043-fa0d-410a-9dbd-4966afb8e956" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.706414] env[65943]: INFO networking_nsxv3.common.synchronization [req-84138fd8-273d-49ec-bd79-2f785ebe5527 req-8a221651-958f-45a1-a24a-795e2ba8f171 tempest-ServerExternalEventsTest-1641294224 tempest-ServerExternalEventsTest-1641294224-project-member] Enqueued Resource ID: 27b85908-8ec4-43b9-a75f-406d0e56ea98 with Priority: HIGHEST for action security_group_members [ 692.707771] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27b85908-8ec4-43b9-a75f-406d0e56ea98 with Priority: HIGHEST for action security_group_members [ 692.708157] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-27b85908-8ec4-43b9-a75f-406d0e56ea98 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.708343] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27b85908-8ec4-43b9-a75f-406d0e56ea98" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.708427] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27b85908-8ec4-43b9-a75f-406d0e56ea98" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.708690] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27b85908-8ec4-43b9-a75f-406d0e56ea98" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.708854] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.708962] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.709039] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.709279] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.709371] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.709874] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27b85908-8ec4-43b9-a75f-406d0e56ea98',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.832408] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4f83bf4-ed34-4088-a422-46a4d9e5c7e1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.093343] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bad8ffbf-a375-4ee1-b522-c5e84af1b840 in Status: SUCCESS [ 693.093343] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bad8ffbf-a375-4ee1-b522-c5e84af1b840" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.093527] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bad8ffbf-a375-4ee1-b522-c5e84af1b840" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.094217] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bad8ffbf-a375-4ee1-b522-c5e84af1b840" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.094217] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.094217] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.094217] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.094635] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.094635] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.094635] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bad8ffbf-a375-4ee1-b522-c5e84af1b840" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.094710] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bad8ffbf-a375-4ee1-b522-c5e84af1b840',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.113542] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-651 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.113768] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.113881] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.114183] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.114612] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.114864] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.115024] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.115626] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.115872] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.116300] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 693.116452] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 693.116689] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 693.116843] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 693.117095] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 693.117850] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 693.117850] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 693.141528] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 693.141757] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 693.141910] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 693.142268] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.142458] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-0ba1572c-6445-436d-aa04-df0c002378fc taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.142642] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-0ba1572c-6445-436d-aa04-df0c002378fc" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.142754] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-0ba1572c-6445-436d-aa04-df0c002378fc" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.143118] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-0ba1572c-6445-436d-aa04-df0c002378fc" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.143263] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ba1572c-6445-436d-aa04-df0c002378fc',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.215476] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.215699] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.215699] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.215980] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.216092] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.216302] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.216415] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.216455] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.216624] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.216697] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.217982] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27b85908-8ec4-43b9-a75f-406d0e56ea98 already deleted. [ 693.217982] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27b85908-8ec4-43b9-a75f-406d0e56ea98" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.246584] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcee84a2-5f8e-4aff-856c-81b817d31434 in Status: SUCCESS [ 693.246823] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcee84a2-5f8e-4aff-856c-81b817d31434 deletion is rescheduled due to dependency. [ 693.246869] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcee84a2-5f8e-4aff-856c-81b817d31434" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.338598] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.338808] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.338808] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.339050] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.339144] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.339244] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 is going to be created. [ 693.369376] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.369523] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.369590] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.369798] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.369978] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.379341] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 in Status: UNINITIALIZED for 2s [ 693.421556] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 82c62f05-41a4-43fb-a74d-0baaee3b8043 in Status: SUCCESS [ 693.421779] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-82c62f05-41a4-43fb-a74d-0baaee3b8043" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.534591] env[65943]: INFO networking_nsxv3.common.synchronization [req-a5c46fae-9651-4fa2-94a7-35bfd891f11d req-33674140-13ff-4999-b4cc-6d7bd945ef2c tempest-VolumesAdminNegativeTest-1398229337 tempest-VolumesAdminNegativeTest-1398229337-project-member] Enqueued Resource ID: 9539d191-87a5-4727-b693-a846f1e6f855 with Priority: HIGHEST for action security_group_members [ 693.535835] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9539d191-87a5-4727-b693-a846f1e6f855 with Priority: HIGHEST for action security_group_members [ 693.535835] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-9539d191-87a5-4727-b693-a846f1e6f855 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.536411] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9539d191-87a5-4727-b693-a846f1e6f855" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.536411] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9539d191-87a5-4727-b693-a846f1e6f855" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.536549] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9539d191-87a5-4727-b693-a846f1e6f855" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.536703] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.536871] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.536948] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.537192] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.541030] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.541030] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9539d191-87a5-4727-b693-a846f1e6f855',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.596999] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bad8ffbf-a375-4ee1-b522-c5e84af1b840',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.645886] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.646126] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.646254] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.646593] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.646660] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.646960] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port 0ba1572c-6445-436d-aa04-df0c002378fc not found, creating... [ 693.647127] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.647314] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.647439] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.647706] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.647875] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.648178] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.648327] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.648615] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.648615] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.648739] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.648870] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: 0ba1572c-6445-436d-aa04-df0c002378fc is going to be created. [ 693.671115] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.671327] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.671446] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.671723] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.674028] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.674028] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-0ba1572c-6445-436d-aa04-df0c002378fc" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.030945] env[65943]: INFO networking_nsxv3.common.synchronization [req-4326e3a1-31b9-46fa-b380-6381e1959f7d req-3f188ea0-2fd6-4a32-ac44-95659cec474a tempest-ServerDiskConfigTestJSON-397438939 tempest-ServerDiskConfigTestJSON-397438939-project-member] Enqueued Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_members [ 694.031921] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_members [ 694.032263] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b127ff-135f-4cd2-9456-bc11d98737ce taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.032396] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.032452] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.032786] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.032962] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.033107] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.033172] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.033302] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.033395] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.033486] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.040470] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.040621] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.040975] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.041076] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.041170] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.041368] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.041486] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.041539] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.041674] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.041746] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.041834] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9539d191-87a5-4727-b693-a846f1e6f855 is going to be updated. [ 694.087018] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.087018] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.087018] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.087309] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.087400] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.099577] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bad8ffbf-a375-4ee1-b522-c5e84af1b840: rpc.has_security_group_logging(os_id): False [ 694.104228] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9539d191-87a5-4727-b693-a846f1e6f855 in Status: IN_PROGRESS for 2s [ 694.122985] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.125076] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.125076] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.125076] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.125076] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.125076] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.125076] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.125076] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.125076] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.125076] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.125076] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bad8ffbf-a375-4ee1-b522-c5e84af1b840 is going to be created. [ 694.214413] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.217029] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.217029] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.217029] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.217029] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.234685] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bad8ffbf-a375-4ee1-b522-c5e84af1b840 in Status: IN_PROGRESS for 2s [ 694.491336] env[65943]: INFO networking_nsxv3.common.synchronization [req-84138fd8-273d-49ec-bd79-2f785ebe5527 req-369fb6a7-ff9c-4d6a-aae0-71052dd21ca2 service nova] Enqueued Resource ID: 27b85908-8ec4-43b9-a75f-406d0e56ea98 with Priority: HIGHEST for action security_group_rules [ 694.491492] env[65943]: INFO networking_nsxv3.common.synchronization [req-84138fd8-273d-49ec-bd79-2f785ebe5527 req-369fb6a7-ff9c-4d6a-aae0-71052dd21ca2 service nova] Enqueued Resource ID: 27b85908-8ec4-43b9-a75f-406d0e56ea98 with Priority: HIGHEST for action security_group_members [ 694.491644] env[65943]: INFO networking_nsxv3.common.synchronization [req-84138fd8-273d-49ec-bd79-2f785ebe5527 req-369fb6a7-ff9c-4d6a-aae0-71052dd21ca2 service nova] Enqueued Resource ID: 0ba1572c-6445-436d-aa04-df0c002378fc with Priority: HIGHEST for action port [ 694.492303] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27b85908-8ec4-43b9-a75f-406d0e56ea98 with Priority: HIGHEST for action security_group_rules [ 694.492452] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27b85908-8ec4-43b9-a75f-406d0e56ea98 with Priority: HIGHEST for action security_group_members [ 694.492562] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ba1572c-6445-436d-aa04-df0c002378fc with Priority: HIGHEST for action port [ 694.492922] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-27b85908-8ec4-43b9-a75f-406d0e56ea98 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.493122] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-27b85908-8ec4-43b9-a75f-406d0e56ea98" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.493122] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-27b85908-8ec4-43b9-a75f-406d0e56ea98" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.494719] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-27b85908-8ec4-43b9-a75f-406d0e56ea98" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.494819] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('27b85908-8ec4-43b9-a75f-406d0e56ea98',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.497128] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-27b85908-8ec4-43b9-a75f-406d0e56ea98 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.497285] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27b85908-8ec4-43b9-a75f-406d0e56ea98" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.497397] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27b85908-8ec4-43b9-a75f-406d0e56ea98" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.497639] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27b85908-8ec4-43b9-a75f-406d0e56ea98" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.498775] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.498775] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.498775] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.498775] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.498775] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.498775] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27b85908-8ec4-43b9-a75f-406d0e56ea98',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.499325] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ba1572c-6445-436d-aa04-df0c002378fc taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.499452] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ba1572c-6445-436d-aa04-df0c002378fc" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.499506] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ba1572c-6445-436d-aa04-df0c002378fc" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.499675] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ba1572c-6445-436d-aa04-df0c002378fc" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.499748] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ba1572c-6445-436d-aa04-df0c002378fc',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.537019] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.537019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.537019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.537019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.537019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.537213] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.537213] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.537638] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.537638] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.537638] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.537778] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9b127ff-135f-4cd2-9456-bc11d98737ce is going to be updated. [ 694.585693] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.585693] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.585693] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.585693] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.585693] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.597220] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b127ff-135f-4cd2-9456-bc11d98737ce in Status: IN_PROGRESS for 2s [ 695.001397] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('27b85908-8ec4-43b9-a75f-406d0e56ea98',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.002626] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-27b85908-8ec4-43b9-a75f-406d0e56ea98 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.002626] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27b85908-8ec4-43b9-a75f-406d0e56ea98" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.002777] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0ba1572c-6445-436d-aa04-df0c002378fc with status ACTIVE [ 695.006578] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.006774] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.006847] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.007075] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.007171] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.007385] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.007483] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.007544] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.007700] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.007778] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.007960] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.008112] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.008174] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.008313] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.008383] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.008467] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0ba1572c-6445-436d-aa04-df0c002378fc is going to be updated. [ 695.031510] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.031877] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.031877] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.032845] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.032980] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.033278] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ba1572c-6445-436d-aa04-df0c002378fc" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.389373] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 in Status: SUCCESS [ 695.389588] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.389750] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.390656] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.390656] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.390656] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.390656] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.390656] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.390656] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.390656] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.390978] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4f83bf4-ed34-4088-a422-46a4d9e5c7e1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.510211] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('27b85908-8ec4-43b9-a75f-406d0e56ea98',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.892436] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4f83bf4-ed34-4088-a422-46a4d9e5c7e1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.014089] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.014241] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.014309] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.014525] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.014609] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.014704] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27b85908-8ec4-43b9-a75f-406d0e56ea98 is going to be created. [ 696.044210] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.045108] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.045108] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.045108] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.045108] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.055509] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27b85908-8ec4-43b9-a75f-406d0e56ea98 in Status: UNINITIALIZED for 2s [ 696.116978] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9539d191-87a5-4727-b693-a846f1e6f855 in Status: SUCCESS [ 696.117264] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9539d191-87a5-4727-b693-a846f1e6f855 deletion is rescheduled due to dependency. [ 696.117408] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9539d191-87a5-4727-b693-a846f1e6f855" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.310163] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bad8ffbf-a375-4ee1-b522-c5e84af1b840 in Status: SUCCESS [ 696.310163] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bad8ffbf-a375-4ee1-b522-c5e84af1b840" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.396304] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4f83bf4-ed34-4088-a422-46a4d9e5c7e1: rpc.has_security_group_logging(os_id): False [ 696.418050] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.420023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.420023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.420023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.420023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.420023] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.420023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.420023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.420023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.420023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.420023] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 is going to be created. [ 696.490161] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.490359] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.490479] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.490722] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.490977] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.505398] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 in Status: IN_PROGRESS for 2s [ 696.621697] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b127ff-135f-4cd2-9456-bc11d98737ce in Status: SUCCESS [ 696.623268] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9b127ff-135f-4cd2-9456-bc11d98737ce deletion is rescheduled due to dependency. [ 696.623268] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.067956] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27b85908-8ec4-43b9-a75f-406d0e56ea98 in Status: SUCCESS [ 698.069028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27b85908-8ec4-43b9-a75f-406d0e56ea98" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.069028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27b85908-8ec4-43b9-a75f-406d0e56ea98" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.069028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27b85908-8ec4-43b9-a75f-406d0e56ea98" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.069028] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.069028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.069028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.069571] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.069571] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.069571] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27b85908-8ec4-43b9-a75f-406d0e56ea98" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.069571] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('27b85908-8ec4-43b9-a75f-406d0e56ea98',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.526249] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 in Status: SUCCESS [ 698.526249] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.575861] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-27b85908-8ec4-43b9-a75f-406d0e56ea98 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.575861] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27b85908-8ec4-43b9-a75f-406d0e56ea98" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.575861] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27b85908-8ec4-43b9-a75f-406d0e56ea98" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.575861] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27b85908-8ec4-43b9-a75f-406d0e56ea98" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.575861] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.575861] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.575861] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.575861] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.575861] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.575861] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27b85908-8ec4-43b9-a75f-406d0e56ea98" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.575861] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-27b85908-8ec4-43b9-a75f-406d0e56ea98 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.575861] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27b85908-8ec4-43b9-a75f-406d0e56ea98" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.575861] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27b85908-8ec4-43b9-a75f-406d0e56ea98" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.575861] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27b85908-8ec4-43b9-a75f-406d0e56ea98" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.575861] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.575861] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.576558] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.576558] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.576558] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.577053] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27b85908-8ec4-43b9-a75f-406d0e56ea98" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.577185] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('27b85908-8ec4-43b9-a75f-406d0e56ea98',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.082190] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 27b85908-8ec4-43b9-a75f-406d0e56ea98: rpc.has_security_group_logging(os_id): False [ 699.106024] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.106214] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.106350] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.106720] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.106720] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.106936] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.106936] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.107099] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.107210] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.107292] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.108349] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.108349] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.108349] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.108349] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.108349] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.108349] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.110318] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.110318] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.110318] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.110318] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.110318] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 27b85908-8ec4-43b9-a75f-406d0e56ea98 is going to be created. [ 699.134061] env[65943]: INFO networking_nsxv3.common.synchronization [req-d6ee49ce-366f-4940-852e-55be1b65b6fa req-3e7843eb-0694-4675-b5a5-f7bed0c0f8c2 tempest-AttachInterfacesTestJSON-882476571 tempest-AttachInterfacesTestJSON-882476571-project-member] Enqueued Resource ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 with Priority: HIGHEST for action security_group_members [ 699.134061] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 with Priority: HIGHEST for action security_group_members [ 699.134222] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8a054b-6bee-465e-84da-d50dfdc27f64 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.134291] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.134345] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.134536] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.134697] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.134821] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.135520] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.135520] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.135520] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.135520] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.216228] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.216518] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.216612] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.217580] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.217999] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.244389] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 27b85908-8ec4-43b9-a75f-406d0e56ea98 in Status: IN_PROGRESS for 2s [ 699.644436] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.644620] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.644695] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.644984] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.645128] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.645362] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.646901] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.646901] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.646901] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.646901] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.646901] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 is going to be updated. [ 699.686751] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.686896] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.686970] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.687304] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.687488] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.702601] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 in Status: IN_PROGRESS for 2s [ 701.261931] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 27b85908-8ec4-43b9-a75f-406d0e56ea98 in Status: SUCCESS [ 701.262925] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-27b85908-8ec4-43b9-a75f-406d0e56ea98" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.428513] env[65943]: INFO networking_nsxv3.common.synchronization [req-f924cad3-df1b-4ac2-a0c6-bf7a6acea923 req-99a00f9a-912c-4b1b-aa19-95588a07b994 tempest-ServerActionsTestOtherA-92071881 tempest-ServerActionsTestOtherA-92071881-project-member] Enqueued Resource ID: 3e3d8b17-4394-4674-b793-075706514abb with Priority: HIGHEST for action security_group_members [ 701.429123] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3d8b17-4394-4674-b793-075706514abb with Priority: HIGHEST for action security_group_members [ 701.429435] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3d8b17-4394-4674-b793-075706514abb taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.429543] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.430188] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.430188] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.430188] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.432014] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.432085] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.432266] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.432368] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.432458] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e3d8b17-4394-4674-b793-075706514abb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.717534] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 in Status: SUCCESS [ 701.717767] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 deletion is rescheduled due to dependency. [ 701.717831] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.934288] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.934445] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.934515] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.934746] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.934835] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.935048] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.935166] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.935251] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.935416] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.935492] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.935581] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e3d8b17-4394-4674-b793-075706514abb already deleted. [ 701.935736] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.121674] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-863 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.121908] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-863" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.121997] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-863" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.122359] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-863" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.122667] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.122753] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.122851] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.123550] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.124152] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.124215] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 702.124308] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 702.124559] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 702.124656] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 702.124809] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 702.124882] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 702.125044] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 702.152132] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 702.152132] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 702.152132] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 702.152132] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-863" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.152132] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-39df3f61-e89a-4be8-8d2a-eb929c5ad8df taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.152132] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-39df3f61-e89a-4be8-8d2a-eb929c5ad8df" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.152132] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-39df3f61-e89a-4be8-8d2a-eb929c5ad8df" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.152132] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-39df3f61-e89a-4be8-8d2a-eb929c5ad8df" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.152132] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39df3f61-e89a-4be8-8d2a-eb929c5ad8df',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.552841] env[65943]: INFO networking_nsxv3.common.synchronization [req-f5b406a2-9eff-487f-8fbe-d31c44fc351a req-7717277c-c119-4a41-8b7d-abb3caee6a49 tempest-ServersTestBootFromVolume-62984311 tempest-ServersTestBootFromVolume-62984311-project-member] Enqueued Resource ID: 1059706e-9846-4d25-98c7-43c5aa686d19 with Priority: HIGHEST for action security_group_members [ 702.553666] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1059706e-9846-4d25-98c7-43c5aa686d19 with Priority: HIGHEST for action security_group_members [ 702.554031] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-1059706e-9846-4d25-98c7-43c5aa686d19 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.554207] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1059706e-9846-4d25-98c7-43c5aa686d19" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.554358] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1059706e-9846-4d25-98c7-43c5aa686d19" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.554572] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1059706e-9846-4d25-98c7-43c5aa686d19" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.554781] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.554914] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.554948] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.555196] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.555366] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.555517] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1059706e-9846-4d25-98c7-43c5aa686d19',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.657720] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.657939] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.657985] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.658325] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.658436] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.658587] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port 39df3f61-e89a-4be8-8d2a-eb929c5ad8df not found, creating... [ 702.658882] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.659077] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.659193] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.659409] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.659536] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.659805] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.659956] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.660059] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.660345] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.660549] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.660709] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: 39df3f61-e89a-4be8-8d2a-eb929c5ad8df is going to be created. [ 702.684818] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.684818] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.684818] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.684818] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.684818] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.684818] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-39df3f61-e89a-4be8-8d2a-eb929c5ad8df" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.937095] env[65943]: INFO networking_nsxv3.common.synchronization [req-4b8c494a-6386-4f55-8117-6d3de7eee5c7 req-829769bb-a419-4211-992c-0bba55fa1086 tempest-ServerDiagnosticsTest-441166188 tempest-ServerDiagnosticsTest-441166188-project-member] Enqueued Resource ID: 82c62f05-41a4-43fb-a74d-0baaee3b8043 with Priority: HIGHEST for action security_group_members [ 702.937716] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82c62f05-41a4-43fb-a74d-0baaee3b8043 with Priority: HIGHEST for action security_group_members [ 702.939356] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-82c62f05-41a4-43fb-a74d-0baaee3b8043 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.939356] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82c62f05-41a4-43fb-a74d-0baaee3b8043" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.939356] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82c62f05-41a4-43fb-a74d-0baaee3b8043" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.939356] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82c62f05-41a4-43fb-a74d-0baaee3b8043" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.939356] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.939356] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.939356] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.939356] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.939728] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.939728] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82c62f05-41a4-43fb-a74d-0baaee3b8043',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.059753] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.059908] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.059975] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.060234] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.060357] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.060557] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.060649] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.060769] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.060940] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.061089] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.061221] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1059706e-9846-4d25-98c7-43c5aa686d19 is going to be updated. [ 703.092944] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.093156] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.093156] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.093487] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.093666] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.105944] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1059706e-9846-4d25-98c7-43c5aa686d19 in Status: IN_PROGRESS for 2s [ 703.411472] env[65943]: INFO networking_nsxv3.common.synchronization [req-f924cad3-df1b-4ac2-a0c6-bf7a6acea923 req-da3f9aa5-ec55-4f36-98f7-7b0f1b58c400 service nova] Enqueued Resource ID: 3e3d8b17-4394-4674-b793-075706514abb with Priority: HIGHEST for action security_group_rules [ 703.411627] env[65943]: INFO networking_nsxv3.common.synchronization [req-f924cad3-df1b-4ac2-a0c6-bf7a6acea923 req-da3f9aa5-ec55-4f36-98f7-7b0f1b58c400 service nova] Enqueued Resource ID: 3e3d8b17-4394-4674-b793-075706514abb with Priority: HIGHEST for action security_group_members [ 703.411870] env[65943]: INFO networking_nsxv3.common.synchronization [req-f924cad3-df1b-4ac2-a0c6-bf7a6acea923 req-da3f9aa5-ec55-4f36-98f7-7b0f1b58c400 service nova] Enqueued Resource ID: 39df3f61-e89a-4be8-8d2a-eb929c5ad8df with Priority: HIGHEST for action port [ 703.411935] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3d8b17-4394-4674-b793-075706514abb with Priority: HIGHEST for action security_group_rules [ 703.412081] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3d8b17-4394-4674-b793-075706514abb with Priority: HIGHEST for action security_group_members [ 703.412182] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39df3f61-e89a-4be8-8d2a-eb929c5ad8df with Priority: HIGHEST for action port [ 703.412813] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e3d8b17-4394-4674-b793-075706514abb taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.412970] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.412970] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.413126] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.413197] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e3d8b17-4394-4674-b793-075706514abb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.414040] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3d8b17-4394-4674-b793-075706514abb taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.414182] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.414252] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.414945] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.415121] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.415222] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.415783] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.415966] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.416081] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.416178] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e3d8b17-4394-4674-b793-075706514abb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.417212] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-39df3f61-e89a-4be8-8d2a-eb929c5ad8df taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.417360] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39df3f61-e89a-4be8-8d2a-eb929c5ad8df" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.417452] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39df3f61-e89a-4be8-8d2a-eb929c5ad8df" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.417675] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39df3f61-e89a-4be8-8d2a-eb929c5ad8df" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.417794] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39df3f61-e89a-4be8-8d2a-eb929c5ad8df',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.443525] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.446531] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.446531] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.446531] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.446531] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.446531] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.446531] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.446531] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.446531] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.446531] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.446531] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82c62f05-41a4-43fb-a74d-0baaee3b8043 is going to be updated. [ 703.477668] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.477881] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.478152] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.478400] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.478582] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.489382] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82c62f05-41a4-43fb-a74d-0baaee3b8043 in Status: IN_PROGRESS for 2s [ 703.920633] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3d8b17-4394-4674-b793-075706514abb taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.920633] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.923066] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e3d8b17-4394-4674-b793-075706514abb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.923066] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 39df3f61-e89a-4be8-8d2a-eb929c5ad8df with status ACTIVE [ 703.923066] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.923066] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.923066] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.923373] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.923373] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.923516] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.923605] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.923663] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.923833] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.923909] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.924159] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.924227] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.924296] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.924424] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.924493] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.924573] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 39df3f61-e89a-4be8-8d2a-eb929c5ad8df is going to be updated. [ 703.958343] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.960603] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.960603] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.960603] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.960603] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.960603] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39df3f61-e89a-4be8-8d2a-eb929c5ad8df" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.120782] env[65943]: INFO networking_nsxv3.common.synchronization [req-6ab0c88d-3ba3-492f-ac1b-624d8cd06de1 req-800fbb3d-a50f-4b07-9d35-11d254c3e251 tempest-ServersAdminTestJSON-910281195 tempest-ServersAdminTestJSON-910281195-project-member] Enqueued Resource ID: e02be8c7-70b1-4488-b079-b1ebf20a733c with Priority: HIGHEST for action security_group_members [ 704.121410] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e02be8c7-70b1-4488-b079-b1ebf20a733c with Priority: HIGHEST for action security_group_members [ 704.121769] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e02be8c7-70b1-4488-b079-b1ebf20a733c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.121890] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.121978] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.122388] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.122594] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.122717] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.122808] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.123102] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.123102] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.124175] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.411833] env[65943]: INFO networking_nsxv3.common.synchronization [req-752b478a-f1b4-4c93-8446-498edf4ecc34 req-298a652f-fba2-4ef9-ae87-2ef6b41a1140 tempest-AttachInterfacesTestJSON-882476571 tempest-AttachInterfacesTestJSON-882476571-project-member] Enqueued Resource ID: ab9efec0-c13a-4960-afb7-a800c8e897d8 with Priority: HIGHEST for action security_group_members [ 704.412801] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab9efec0-c13a-4960-afb7-a800c8e897d8 with Priority: HIGHEST for action security_group_members [ 704.413390] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab9efec0-c13a-4960-afb7-a800c8e897d8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.413602] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab9efec0-c13a-4960-afb7-a800c8e897d8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.413719] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab9efec0-c13a-4960-afb7-a800c8e897d8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.414148] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab9efec0-c13a-4960-afb7-a800c8e897d8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.414419] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.414586] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.414691] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.414949] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.415610] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.415805] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab9efec0-c13a-4960-afb7-a800c8e897d8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.428697] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e3d8b17-4394-4674-b793-075706514abb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.627447] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.920855] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.921322] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.921322] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.923318] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.923443] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.923668] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.923784] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.923948] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.924043] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.924108] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.924188] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab9efec0-c13a-4960-afb7-a800c8e897d8 is going to be updated. [ 704.932273] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.932483] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.932590] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.932791] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.933169] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.933317] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e3d8b17-4394-4674-b793-075706514abb is going to be created. [ 704.955811] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.956050] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.956155] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.956428] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.956618] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.960721] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.960991] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.961148] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.961439] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.961712] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.967892] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab9efec0-c13a-4960-afb7-a800c8e897d8 in Status: IN_PROGRESS for 2s [ 704.972643] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3d8b17-4394-4674-b793-075706514abb in Status: UNINITIALIZED for 2s [ 705.117452] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1059706e-9846-4d25-98c7-43c5aa686d19 in Status: SUCCESS [ 705.117561] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1059706e-9846-4d25-98c7-43c5aa686d19 deletion is rescheduled due to dependency. [ 705.117659] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1059706e-9846-4d25-98c7-43c5aa686d19" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.131242] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.343703] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-581 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.343985] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-581" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.344173] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-581" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.344375] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-581" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.344715] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.344773] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.344875] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.345274] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.345455] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.345705] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 705.345758] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 705.345849] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 705.346015] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 705.346186] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 705.346288] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 705.346872] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 705.367177] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 705.367177] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 705.367177] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 705.367313] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-581" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.367582] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-013a7db9-04ec-438a-92ab-eedc230bdd4b taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.367748] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-013a7db9-04ec-438a-92ab-eedc230bdd4b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.367891] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-013a7db9-04ec-438a-92ab-eedc230bdd4b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.368256] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-013a7db9-04ec-438a-92ab-eedc230bdd4b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.368444] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('013a7db9-04ec-438a-92ab-eedc230bdd4b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.500644] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82c62f05-41a4-43fb-a74d-0baaee3b8043 in Status: SUCCESS [ 705.500825] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82c62f05-41a4-43fb-a74d-0baaee3b8043 deletion is rescheduled due to dependency. [ 705.500952] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82c62f05-41a4-43fb-a74d-0baaee3b8043" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.633707] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.634042] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.634042] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.634438] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.634438] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.634438] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e02be8c7-70b1-4488-b079-b1ebf20a733c is going to be updated. [ 705.639386] env[65943]: INFO networking_nsxv3.common.synchronization [None req-dc8edb57-cbe8-4fb3-917c-8b59a1c70884 None None] Enqueued Resource ID: ed48b475-2661-4ef9-839f-5e6a3f4bcc2c with Priority: HIGHEST for action port [ 705.639816] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed48b475-2661-4ef9-839f-5e6a3f4bcc2c with Priority: HIGHEST for action port [ 705.640166] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed48b475-2661-4ef9-839f-5e6a3f4bcc2c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.640328] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed48b475-2661-4ef9-839f-5e6a3f4bcc2c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.640416] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed48b475-2661-4ef9-839f-5e6a3f4bcc2c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.640694] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed48b475-2661-4ef9-839f-5e6a3f4bcc2c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.640804] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed48b475-2661-4ef9-839f-5e6a3f4bcc2c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.668936] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.669123] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.669160] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.669549] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.669712] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.689012] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e02be8c7-70b1-4488-b079-b1ebf20a733c in Status: IN_PROGRESS for 2s [ 705.872345] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.872345] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.875859] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.876256] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.876413] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.876573] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port 013a7db9-04ec-438a-92ab-eedc230bdd4b not found, creating... [ 705.876895] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.877105] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.877188] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.877633] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.877748] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.878045] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.878242] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.878355] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.880341] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.880341] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.880341] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: 013a7db9-04ec-438a-92ab-eedc230bdd4b is going to be created. [ 705.903794] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.904027] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.904237] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.905215] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.905215] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.905215] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-013a7db9-04ec-438a-92ab-eedc230bdd4b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.144710] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ed48b475-2661-4ef9-839f-5e6a3f4bcc2c [ 706.145156] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.145528] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.145528] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.145688] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.145732] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.145814] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ed48b475-2661-4ef9-839f-5e6a3f4bcc2c already deleted. [ 706.146863] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed48b475-2661-4ef9-839f-5e6a3f4bcc2c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.428039] env[65943]: INFO networking_nsxv3.common.synchronization [None req-33e21f6b-70b0-4424-b071-599e5b117163 None None] Enqueued Resource ID: d2bd0808-6ebc-46aa-a5d3-c24dca4cc868 with Priority: HIGHEST for action port [ 706.428039] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2bd0808-6ebc-46aa-a5d3-c24dca4cc868 with Priority: HIGHEST for action port [ 706.428039] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-d2bd0808-6ebc-46aa-a5d3-c24dca4cc868 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.428039] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d2bd0808-6ebc-46aa-a5d3-c24dca4cc868" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.428039] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d2bd0808-6ebc-46aa-a5d3-c24dca4cc868" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.428039] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d2bd0808-6ebc-46aa-a5d3-c24dca4cc868" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.428039] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2bd0808-6ebc-46aa-a5d3-c24dca4cc868',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.675081] env[65943]: INFO networking_nsxv3.common.synchronization [req-6ab0c88d-3ba3-492f-ac1b-624d8cd06de1 req-61fdda03-3b0d-40da-97bf-4cbdf5661465 service nova] Enqueued Resource ID: e02be8c7-70b1-4488-b079-b1ebf20a733c with Priority: HIGHEST for action security_group_rules [ 706.675081] env[65943]: INFO networking_nsxv3.common.synchronization [req-6ab0c88d-3ba3-492f-ac1b-624d8cd06de1 req-61fdda03-3b0d-40da-97bf-4cbdf5661465 service nova] Enqueued Resource ID: e02be8c7-70b1-4488-b079-b1ebf20a733c with Priority: HIGHEST for action security_group_members [ 706.675081] env[65943]: INFO networking_nsxv3.common.synchronization [req-6ab0c88d-3ba3-492f-ac1b-624d8cd06de1 req-61fdda03-3b0d-40da-97bf-4cbdf5661465 service nova] Enqueued Resource ID: 013a7db9-04ec-438a-92ab-eedc230bdd4b with Priority: HIGHEST for action port [ 706.675081] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e02be8c7-70b1-4488-b079-b1ebf20a733c with Priority: HIGHEST for action security_group_rules [ 706.679182] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e02be8c7-70b1-4488-b079-b1ebf20a733c with Priority: HIGHEST for action security_group_members [ 706.679182] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 013a7db9-04ec-438a-92ab-eedc230bdd4b with Priority: HIGHEST for action port [ 706.679182] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e02be8c7-70b1-4488-b079-b1ebf20a733c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.679549] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.679549] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.679549] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.679632] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.681016] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e02be8c7-70b1-4488-b079-b1ebf20a733c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.681417] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.681546] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-013a7db9-04ec-438a-92ab-eedc230bdd4b taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.681674] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-013a7db9-04ec-438a-92ab-eedc230bdd4b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.681792] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-013a7db9-04ec-438a-92ab-eedc230bdd4b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.682100] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-013a7db9-04ec-438a-92ab-eedc230bdd4b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.682202] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('013a7db9-04ec-438a-92ab-eedc230bdd4b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.931972] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d2bd0808-6ebc-46aa-a5d3-c24dca4cc868 [ 706.931972] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.931972] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.931972] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.932286] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.932286] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.932379] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d2bd0808-6ebc-46aa-a5d3-c24dca4cc868 already deleted. [ 706.932428] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d2bd0808-6ebc-46aa-a5d3-c24dca4cc868" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.981343] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3d8b17-4394-4674-b793-075706514abb in Status: SUCCESS [ 706.985024] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.985024] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.985024] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.985024] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.985024] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.985024] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.985024] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.985024] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.985024] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.985024] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e3d8b17-4394-4674-b793-075706514abb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.985024] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab9efec0-c13a-4960-afb7-a800c8e897d8 in Status: SUCCESS [ 706.985024] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab9efec0-c13a-4960-afb7-a800c8e897d8 deletion is rescheduled due to dependency. [ 706.985024] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab9efec0-c13a-4960-afb7-a800c8e897d8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.185066] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e02be8c7-70b1-4488-b079-b1ebf20a733c taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.185066] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.188932] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 013a7db9-04ec-438a-92ab-eedc230bdd4b with status ACTIVE [ 707.188932] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.189047] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.189105] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.189346] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.189452] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.189875] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.189875] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.189875] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.190103] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.190103] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.191137] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.191137] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.191137] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.191137] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.191137] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.191137] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 013a7db9-04ec-438a-92ab-eedc230bdd4b is going to be updated. [ 707.213081] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.213351] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.213351] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.214019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.214019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.214019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-013a7db9-04ec-438a-92ab-eedc230bdd4b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.487835] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e3d8b17-4394-4674-b793-075706514abb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.529494] env[65943]: INFO networking_nsxv3.common.synchronization [req-745aa814-8ceb-4926-b906-981870e838a3 req-94aef87b-8f70-4e66-8734-c715251d434e tempest-ImagesOneServerNegativeTestJSON-477600040 tempest-ImagesOneServerNegativeTestJSON-477600040-project-member] Enqueued Resource ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d with Priority: HIGHEST for action security_group_members [ 707.531014] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d with Priority: HIGHEST for action security_group_members [ 707.531996] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b23ffb1-731f-42f8-bb4b-c106291be34d taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.532172] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.532235] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.532557] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.532733] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.532837] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.532951] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.533113] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.533240] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.533344] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b23ffb1-731f-42f8-bb4b-c106291be34d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.703218] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e02be8c7-70b1-4488-b079-b1ebf20a733c in Status: SUCCESS [ 707.703218] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.703218] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.703218] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.703411] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.703411] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.703489] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.704134] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.704134] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.704134] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.882678] env[65943]: INFO networking_nsxv3.common.synchronization [req-64bda96a-660d-45ee-9aa0-9b5a23bcb349 req-c3022ab8-5298-430e-a55d-8c5f267c2e20 tempest-ServerTagsTestJSON-2057985827 tempest-ServerTagsTestJSON-2057985827-project-member] Enqueued Resource ID: 91dead58-0cf0-4aec-a2ae-571f8dc59b4c with Priority: HIGHEST for action security_group_members [ 707.882678] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91dead58-0cf0-4aec-a2ae-571f8dc59b4c with Priority: HIGHEST for action security_group_members [ 707.882861] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-91dead58-0cf0-4aec-a2ae-571f8dc59b4c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.883028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91dead58-0cf0-4aec-a2ae-571f8dc59b4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.883423] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91dead58-0cf0-4aec-a2ae-571f8dc59b4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.883654] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91dead58-0cf0-4aec-a2ae-571f8dc59b4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.883823] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.883963] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.884587] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.884587] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.884587] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.884757] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('91dead58-0cf0-4aec-a2ae-571f8dc59b4c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.989980] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e3d8b17-4394-4674-b793-075706514abb: rpc.has_security_group_logging(os_id): False [ 708.011470] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.011470] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.011470] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.011470] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.011470] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.011470] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.011470] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.011789] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.011789] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.011920] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.012492] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e3d8b17-4394-4674-b793-075706514abb is going to be created. [ 708.036433] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.036636] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.036636] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.036854] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.037083] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.037330] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.037330] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.037490] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.037490] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.037581] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.037644] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d already deleted. [ 708.037722] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.075728] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.076028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.076028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.078216] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.078457] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.093573] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e3d8b17-4394-4674-b793-075706514abb in Status: IN_PROGRESS for 2s [ 708.206676] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.276689] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-257 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.276883] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-257" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.276992] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-257" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.277337] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-257" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.277584] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.277729] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.277833] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.278110] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.278260] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.278544] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 708.278696] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 708.278835] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 708.278942] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 708.279050] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 708.279146] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 708.279268] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 708.298721] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 708.298862] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 708.299092] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 708.299259] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-257" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.299571] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-a81c8378-3f60-4657-8d55-37be35cf7dba taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.299735] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-a81c8378-3f60-4657-8d55-37be35cf7dba" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.299837] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-a81c8378-3f60-4657-8d55-37be35cf7dba" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.300180] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-a81c8378-3f60-4657-8d55-37be35cf7dba" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.300306] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a81c8378-3f60-4657-8d55-37be35cf7dba',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.386813] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.386963] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.387048] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.387348] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.387467] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.387648] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.387746] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.387793] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.387948] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.388070] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.388159] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 91dead58-0cf0-4aec-a2ae-571f8dc59b4c is going to be updated. [ 708.424199] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.424199] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.424199] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.424199] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.424199] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.441398] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91dead58-0cf0-4aec-a2ae-571f8dc59b4c in Status: IN_PROGRESS for 2s [ 708.577186] env[65943]: INFO networking_nsxv3.common.synchronization [None req-d4755ac0-d2af-4886-890c-325646a810d7 None None] Enqueued Resource ID: 911fde86-eab2-405a-9592-f6303d983f58 with Priority: HIGHEST for action port [ 708.577828] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 911fde86-eab2-405a-9592-f6303d983f58 with Priority: HIGHEST for action port [ 708.582974] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-911fde86-eab2-405a-9592-f6303d983f58 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.582974] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-911fde86-eab2-405a-9592-f6303d983f58" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.582974] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-911fde86-eab2-405a-9592-f6303d983f58" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.582974] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-911fde86-eab2-405a-9592-f6303d983f58" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.583111] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('911fde86-eab2-405a-9592-f6303d983f58',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.710217] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.805709] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.807037] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.809044] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.809649] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.809834] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.810037] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port a81c8378-3f60-4657-8d55-37be35cf7dba not found, creating... [ 708.810318] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.810499] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.810611] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.810882] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.811036] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.811344] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.811501] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.811985] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.811985] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.811985] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.812139] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: a81c8378-3f60-4657-8d55-37be35cf7dba is going to be created. [ 708.834329] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.834552] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.834669] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.834952] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.835228] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.835476] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-a81c8378-3f60-4657-8d55-37be35cf7dba" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.838351] env[65943]: INFO networking_nsxv3.common.synchronization [None req-5906acd2-2093-4c1d-94f1-97acc7147e60 None None] Enqueued Resource ID: bd5b2216-cc3f-41c1-8ae0-61b442a7e64e with Priority: HIGHEST for action port [ 708.839114] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd5b2216-cc3f-41c1-8ae0-61b442a7e64e with Priority: HIGHEST for action port [ 708.839783] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd5b2216-cc3f-41c1-8ae0-61b442a7e64e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.839963] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd5b2216-cc3f-41c1-8ae0-61b442a7e64e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.840088] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd5b2216-cc3f-41c1-8ae0-61b442a7e64e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.840393] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd5b2216-cc3f-41c1-8ae0-61b442a7e64e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.840520] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd5b2216-cc3f-41c1-8ae0-61b442a7e64e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.086305] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 911fde86-eab2-405a-9592-f6303d983f58 [ 709.086305] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.086305] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.086305] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.086305] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.086305] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.086305] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:911fde86-eab2-405a-9592-f6303d983f58 already deleted. [ 709.086305] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-911fde86-eab2-405a-9592-f6303d983f58" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.212747] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.213154] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.213154] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.213311] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.213344] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.213467] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e02be8c7-70b1-4488-b079-b1ebf20a733c is going to be updated. [ 709.242317] env[65943]: INFO networking_nsxv3.common.synchronization [req-5b89b5eb-7814-4a8e-9cb3-5bda528b775c req-2f55dad5-da01-402a-b768-15129e47b4ae tempest-InstanceActionsNegativeTestJSON-727219672 tempest-InstanceActionsNegativeTestJSON-727219672-project-member] Enqueued Resource ID: f293d027-3f3e-402a-bfe6-98af5d29163f with Priority: HIGHEST for action security_group_members [ 709.243362] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f293d027-3f3e-402a-bfe6-98af5d29163f with Priority: HIGHEST for action security_group_members [ 709.243698] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-f293d027-3f3e-402a-bfe6-98af5d29163f taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.243822] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f293d027-3f3e-402a-bfe6-98af5d29163f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.243899] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f293d027-3f3e-402a-bfe6-98af5d29163f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.244168] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f293d027-3f3e-402a-bfe6-98af5d29163f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.244335] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.244442] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.244567] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.244677] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.244909] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.244964] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f293d027-3f3e-402a-bfe6-98af5d29163f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.247471] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.247630] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.247688] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.247820] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.247973] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.259052] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e02be8c7-70b1-4488-b079-b1ebf20a733c in Status: IN_PROGRESS for 2s [ 709.343783] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bd5b2216-cc3f-41c1-8ae0-61b442a7e64e [ 709.344035] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.344181] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.344251] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.344465] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.344560] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.344648] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bd5b2216-cc3f-41c1-8ae0-61b442a7e64e already deleted. [ 709.344730] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd5b2216-cc3f-41c1-8ae0-61b442a7e64e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.583677] env[65943]: INFO networking_nsxv3.common.synchronization [req-745aa814-8ceb-4926-b906-981870e838a3 req-f34b3abc-1d79-4820-a743-f453529fce5a service nova] Enqueued Resource ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d with Priority: HIGHEST for action security_group_rules [ 709.583910] env[65943]: INFO networking_nsxv3.common.synchronization [req-745aa814-8ceb-4926-b906-981870e838a3 req-f34b3abc-1d79-4820-a743-f453529fce5a service nova] Enqueued Resource ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d with Priority: HIGHEST for action security_group_members [ 709.586352] env[65943]: INFO networking_nsxv3.common.synchronization [req-745aa814-8ceb-4926-b906-981870e838a3 req-f34b3abc-1d79-4820-a743-f453529fce5a service nova] Enqueued Resource ID: a81c8378-3f60-4657-8d55-37be35cf7dba with Priority: HIGHEST for action port [ 709.586352] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d with Priority: HIGHEST for action security_group_rules [ 709.586352] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d with Priority: HIGHEST for action security_group_members [ 709.586352] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a81c8378-3f60-4657-8d55-37be35cf7dba with Priority: HIGHEST for action port [ 709.586563] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b23ffb1-731f-42f8-bb4b-c106291be34d taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.586563] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.586681] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.588449] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.588449] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b23ffb1-731f-42f8-bb4b-c106291be34d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.588449] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b23ffb1-731f-42f8-bb4b-c106291be34d taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.588449] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.588740] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.588740] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.589113] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.589113] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.589113] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.589236] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.589320] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.589412] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b23ffb1-731f-42f8-bb4b-c106291be34d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.591597] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-a81c8378-3f60-4657-8d55-37be35cf7dba taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.591705] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a81c8378-3f60-4657-8d55-37be35cf7dba" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.591765] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a81c8378-3f60-4657-8d55-37be35cf7dba" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.591924] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a81c8378-3f60-4657-8d55-37be35cf7dba" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.594687] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a81c8378-3f60-4657-8d55-37be35cf7dba',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.695056] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-561 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.695282] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-561" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.699027] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-561" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.699027] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-561" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.699027] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.699027] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.699027] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.699027] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.699027] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.699027] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 709.699027] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 709.699027] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 709.699027] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 709.699027] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 709.699027] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 709.699027] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 709.727151] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 709.728566] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 709.728566] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 709.729590] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-561" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.729590] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-abe8cf88-67af-4846-b632-363a5d3c7c1e taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.729590] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-abe8cf88-67af-4846-b632-363a5d3c7c1e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.729590] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-abe8cf88-67af-4846-b632-363a5d3c7c1e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.729844] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-abe8cf88-67af-4846-b632-363a5d3c7c1e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.730037] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abe8cf88-67af-4846-b632-363a5d3c7c1e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.747031] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.747322] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.747383] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.747674] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.747774] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.747984] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.748178] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.748267] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.748449] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.748553] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.748664] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f293d027-3f3e-402a-bfe6-98af5d29163f already deleted. [ 709.748769] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f293d027-3f3e-402a-bfe6-98af5d29163f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.096339] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b23ffb1-731f-42f8-bb4b-c106291be34d taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.096485] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.096639] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4b23ffb1-731f-42f8-bb4b-c106291be34d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.097737] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a81c8378-3f60-4657-8d55-37be35cf7dba with status ACTIVE [ 710.097737] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.097907] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.097907] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.098111] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.098204] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.098403] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.098546] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.098620] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.098713] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.098798] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.098997] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.099072] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.099133] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.099271] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.099344] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.099444] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a81c8378-3f60-4657-8d55-37be35cf7dba is going to be updated. [ 710.109594] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e3d8b17-4394-4674-b793-075706514abb in Status: SUCCESS [ 710.109789] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.125296] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.125296] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.125296] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.125296] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.125296] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.125296] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a81c8378-3f60-4657-8d55-37be35cf7dba" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.233594] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.234049] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.234049] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.234324] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.234468] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.234647] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port abe8cf88-67af-4846-b632-363a5d3c7c1e not found, creating... [ 710.234998] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.235212] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.235293] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.235489] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.235710] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.235889] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.236096] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.236218] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.236418] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.236695] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.236848] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: abe8cf88-67af-4846-b632-363a5d3c7c1e is going to be created. [ 710.264065] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.264327] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.264457] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.264765] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.265071] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.265316] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-abe8cf88-67af-4846-b632-363a5d3c7c1e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.453930] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91dead58-0cf0-4aec-a2ae-571f8dc59b4c in Status: SUCCESS [ 710.454144] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 91dead58-0cf0-4aec-a2ae-571f8dc59b4c deletion is rescheduled due to dependency. [ 710.454284] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91dead58-0cf0-4aec-a2ae-571f8dc59b4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.602156] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4b23ffb1-731f-42f8-bb4b-c106291be34d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.105409] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.105568] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.105637] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.105887] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.106094] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.106149] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d is going to be created. [ 711.136250] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.140335] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.140335] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.140335] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.140335] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.153796] env[65943]: INFO networking_nsxv3.common.synchronization [req-5b89b5eb-7814-4a8e-9cb3-5bda528b775c req-0a35b94f-4ccf-4f83-9b96-01f459e5f87f service nova] Enqueued Resource ID: f293d027-3f3e-402a-bfe6-98af5d29163f with Priority: HIGHEST for action security_group_rules [ 711.154068] env[65943]: INFO networking_nsxv3.common.synchronization [req-5b89b5eb-7814-4a8e-9cb3-5bda528b775c req-0a35b94f-4ccf-4f83-9b96-01f459e5f87f service nova] Enqueued Resource ID: f293d027-3f3e-402a-bfe6-98af5d29163f with Priority: HIGHEST for action security_group_members [ 711.154229] env[65943]: INFO networking_nsxv3.common.synchronization [req-5b89b5eb-7814-4a8e-9cb3-5bda528b775c req-0a35b94f-4ccf-4f83-9b96-01f459e5f87f service nova] Enqueued Resource ID: abe8cf88-67af-4846-b632-363a5d3c7c1e with Priority: HIGHEST for action port [ 711.156400] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d in Status: UNINITIALIZED for 2s [ 711.157203] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f293d027-3f3e-402a-bfe6-98af5d29163f with Priority: HIGHEST for action security_group_rules [ 711.157561] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f293d027-3f3e-402a-bfe6-98af5d29163f with Priority: HIGHEST for action security_group_members [ 711.157759] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abe8cf88-67af-4846-b632-363a5d3c7c1e with Priority: HIGHEST for action port [ 711.158232] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f293d027-3f3e-402a-bfe6-98af5d29163f taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.158415] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f293d027-3f3e-402a-bfe6-98af5d29163f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.158988] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f293d027-3f3e-402a-bfe6-98af5d29163f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.158988] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f293d027-3f3e-402a-bfe6-98af5d29163f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.159189] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f293d027-3f3e-402a-bfe6-98af5d29163f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.162417] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-f293d027-3f3e-402a-bfe6-98af5d29163f taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.162617] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f293d027-3f3e-402a-bfe6-98af5d29163f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.162702] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f293d027-3f3e-402a-bfe6-98af5d29163f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.163314] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f293d027-3f3e-402a-bfe6-98af5d29163f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.168065] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.168065] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.168065] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.168065] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.168407] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.168407] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f293d027-3f3e-402a-bfe6-98af5d29163f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.170360] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-abe8cf88-67af-4846-b632-363a5d3c7c1e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.172421] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abe8cf88-67af-4846-b632-363a5d3c7c1e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.172519] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abe8cf88-67af-4846-b632-363a5d3c7c1e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.172800] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abe8cf88-67af-4846-b632-363a5d3c7c1e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.174402] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abe8cf88-67af-4846-b632-363a5d3c7c1e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.272750] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e02be8c7-70b1-4488-b079-b1ebf20a733c in Status: SUCCESS [ 711.272750] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.272750] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.273226] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.273393] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.273549] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.273594] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.273768] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.273836] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.273933] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.274202] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.672830] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f293d027-3f3e-402a-bfe6-98af5d29163f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.681039] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-f293d027-3f3e-402a-bfe6-98af5d29163f taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.681039] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f293d027-3f3e-402a-bfe6-98af5d29163f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.681039] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port abe8cf88-67af-4846-b632-363a5d3c7c1e with status ACTIVE [ 711.681039] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.681039] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.681039] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.681039] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.681039] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.681039] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.681039] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.681039] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.681039] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.681039] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.681039] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.682046] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.682046] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.682046] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.682046] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.682046] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: abe8cf88-67af-4846-b632-363a5d3c7c1e is going to be updated. [ 711.714469] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.714697] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.714697] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.715182] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.715348] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.715523] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abe8cf88-67af-4846-b632-363a5d3c7c1e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.779555] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e02be8c7-70b1-4488-b079-b1ebf20a733c taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.780579] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.780579] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.780766] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.781072] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.781261] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.781385] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.781650] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.781755] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.781877] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.782139] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e02be8c7-70b1-4488-b079-b1ebf20a733c taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.782194] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.782429] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.782502] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.782619] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.782726] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.782798] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.783137] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.783762] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.784100] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.784164] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.175824] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f293d027-3f3e-402a-bfe6-98af5d29163f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.288639] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e02be8c7-70b1-4488-b079-b1ebf20a733c: rpc.has_security_group_logging(os_id): False [ 712.312343] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.312501] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.312554] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.313359] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.313359] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.313359] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.313521] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.313521] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.314085] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.314085] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.314184] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.314254] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.314600] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.314600] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.314665] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.315278] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.315421] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.315515] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.315718] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.317753] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.317753] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e02be8c7-70b1-4488-b079-b1ebf20a733c is going to be updated. [ 712.397248] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.397248] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.397248] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.397492] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.397613] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.419447] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e02be8c7-70b1-4488-b079-b1ebf20a733c in Status: IN_PROGRESS for 2s [ 712.679353] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.680612] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.680612] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.680612] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.680612] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.680612] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f293d027-3f3e-402a-bfe6-98af5d29163f is going to be created. [ 712.726605] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.726817] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.726883] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.727156] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.727675] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.740041] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f293d027-3f3e-402a-bfe6-98af5d29163f in Status: UNINITIALIZED for 2s [ 713.169067] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d in Status: SUCCESS [ 713.169319] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.169492] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.169766] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.169975] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.170109] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.170184] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.170324] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.170412] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.170541] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.170599] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4b23ffb1-731f-42f8-bb4b-c106291be34d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.395203] env[65943]: INFO networking_nsxv3.common.synchronization [req-5ed55519-aaf0-41a3-9e83-599ee2f9a8c8 req-f7842d03-9e3b-4941-9a7d-7b182eb730d0 tempest-ServersAdminNegativeTestJSON-33136479 tempest-ServersAdminNegativeTestJSON-33136479-project-member] Enqueued Resource ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 with Priority: HIGHEST for action security_group_members [ 713.397464] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 with Priority: HIGHEST for action security_group_members [ 713.397931] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-df0b5076-3338-4b40-9ce6-994130c4b8d2 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.398146] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.398262] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.398583] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.398823] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.398994] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.399140] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.399390] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.399536] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.399707] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df0b5076-3338-4b40-9ce6-994130c4b8d2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.673373] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b23ffb1-731f-42f8-bb4b-c106291be34d taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.673536] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.673811] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.674252] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.674579] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.674701] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.674773] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.674972] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.675100] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.675266] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.675475] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b23ffb1-731f-42f8-bb4b-c106291be34d taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.675578] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.675640] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.675835] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.676123] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.676279] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.676357] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.676523] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.676609] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.676694] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.676795] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4b23ffb1-731f-42f8-bb4b-c106291be34d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.903328] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df0b5076-3338-4b40-9ce6-994130c4b8d2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.179543] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4b23ffb1-731f-42f8-bb4b-c106291be34d: rpc.has_security_group_logging(os_id): False [ 714.199695] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.199853] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.199924] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.200155] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.200253] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.200473] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.200573] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.200634] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.200788] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.200870] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.201051] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.201146] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.201205] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.201345] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.201421] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.201643] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.201739] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.201894] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.201937] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.201999] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.202338] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d is going to be created. [ 714.261586] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.261792] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.261896] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.262220] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.262460] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.278091] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d in Status: IN_PROGRESS for 2s [ 714.334169] env[65943]: INFO networking_nsxv3.common.synchronization [req-ef2f16a6-4f02-4b80-9371-7e2f09355952 req-7c42ee0f-162b-44a8-9cc7-7f94882b5fcc tempest-ServerExternalEventsTest-1641294224 tempest-ServerExternalEventsTest-1641294224-project-member] Enqueued Resource ID: 27b85908-8ec4-43b9-a75f-406d0e56ea98 with Priority: HIGHEST for action security_group_members [ 714.334880] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27b85908-8ec4-43b9-a75f-406d0e56ea98 with Priority: HIGHEST for action security_group_members [ 714.335303] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-27b85908-8ec4-43b9-a75f-406d0e56ea98 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.335466] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27b85908-8ec4-43b9-a75f-406d0e56ea98" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.335577] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27b85908-8ec4-43b9-a75f-406d0e56ea98" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.335849] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27b85908-8ec4-43b9-a75f-406d0e56ea98" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.336130] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.336278] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.336378] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.336565] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.336708] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.336854] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27b85908-8ec4-43b9-a75f-406d0e56ea98',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.409076] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df0b5076-3338-4b40-9ce6-994130c4b8d2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.450410] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e02be8c7-70b1-4488-b079-b1ebf20a733c in Status: SUCCESS [ 714.450652] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.751886] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f293d027-3f3e-402a-bfe6-98af5d29163f in Status: SUCCESS [ 714.751886] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f293d027-3f3e-402a-bfe6-98af5d29163f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.752963] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f293d027-3f3e-402a-bfe6-98af5d29163f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.752963] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f293d027-3f3e-402a-bfe6-98af5d29163f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.752963] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.752963] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.752963] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.752963] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.752963] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.753263] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f293d027-3f3e-402a-bfe6-98af5d29163f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.753263] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f293d027-3f3e-402a-bfe6-98af5d29163f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.839410] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.839564] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.839625] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.839933] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.840094] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.840382] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.840727] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.840804] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.840969] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.841076] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.841181] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27b85908-8ec4-43b9-a75f-406d0e56ea98 is going to be updated. [ 714.872258] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.872500] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.872610] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.872882] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.873054] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.888319] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27b85908-8ec4-43b9-a75f-406d0e56ea98 in Status: IN_PROGRESS for 2s [ 714.913562] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.913892] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.913892] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.914064] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.914198] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.914303] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 is going to be updated. [ 714.958199] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.958793] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.958877] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.959106] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.959291] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.970588] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 in Status: IN_PROGRESS for 2s [ 715.258206] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-f293d027-3f3e-402a-bfe6-98af5d29163f taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.258412] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f293d027-3f3e-402a-bfe6-98af5d29163f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.258412] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f293d027-3f3e-402a-bfe6-98af5d29163f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.259677] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f293d027-3f3e-402a-bfe6-98af5d29163f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.259677] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.259813] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.259813] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.260231] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.261189] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.261189] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f293d027-3f3e-402a-bfe6-98af5d29163f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.261189] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-f293d027-3f3e-402a-bfe6-98af5d29163f taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.262557] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f293d027-3f3e-402a-bfe6-98af5d29163f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.262557] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f293d027-3f3e-402a-bfe6-98af5d29163f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.262557] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f293d027-3f3e-402a-bfe6-98af5d29163f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.262557] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.262557] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.262557] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.262557] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.262557] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.262557] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f293d027-3f3e-402a-bfe6-98af5d29163f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.262557] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f293d027-3f3e-402a-bfe6-98af5d29163f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.767369] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f293d027-3f3e-402a-bfe6-98af5d29163f: rpc.has_security_group_logging(os_id): False [ 715.789051] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.789051] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.789051] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.789051] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.789051] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.789548] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.789548] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.789548] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.789548] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.789667] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.790135] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.790135] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.790135] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.790135] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.790309] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.790401] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.790488] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.790545] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.790713] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.790787] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.790869] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f293d027-3f3e-402a-bfe6-98af5d29163f is going to be created. [ 715.860697] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.860815] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.861651] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.861960] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.861960] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.874190] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f293d027-3f3e-402a-bfe6-98af5d29163f in Status: IN_PROGRESS for 2s [ 716.272032] env[65943]: INFO networking_nsxv3.common.synchronization [req-78686ba9-38f7-46d6-8f81-d77431e9f696 req-8ddef74d-0512-4671-95da-2ac76ce0908e tempest-ServerDiskConfigTestJSON-397438939 tempest-ServerDiskConfigTestJSON-397438939-project-member] Enqueued Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_members [ 716.272727] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_members [ 716.273083] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b127ff-135f-4cd2-9456-bc11d98737ce taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.273220] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.276344] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.276344] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.276344] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.276344] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.276344] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.276344] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.276344] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.276344] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.293485] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d in Status: SUCCESS [ 716.293737] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.606470] env[65943]: INFO networking_nsxv3.common.synchronization [req-1902e59b-c546-4786-8e65-8e1114d4bd9d req-f323645d-4bf7-42e1-85c5-668c87aa4352 tempest-ServerMetadataTestJSON-106407786 tempest-ServerMetadataTestJSON-106407786-project-member] Enqueued Resource ID: 78f53cda-281e-4098-b286-926afd0b084e with Priority: HIGHEST for action security_group_members [ 716.606955] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78f53cda-281e-4098-b286-926afd0b084e with Priority: HIGHEST for action security_group_members [ 716.607277] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-78f53cda-281e-4098-b286-926afd0b084e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.607419] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78f53cda-281e-4098-b286-926afd0b084e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.607489] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78f53cda-281e-4098-b286-926afd0b084e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.607750] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78f53cda-281e-4098-b286-926afd0b084e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.607927] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.608043] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.608140] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.608315] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.608836] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.608836] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78f53cda-281e-4098-b286-926afd0b084e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.779322] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.779322] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.779322] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.779322] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.779975] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.779975] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.779975] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.779975] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.779975] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.779975] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.780380] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9b127ff-135f-4cd2-9456-bc11d98737ce is going to be updated. [ 716.817968] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.817968] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.817968] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.817968] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.818167] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.832653] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b127ff-135f-4cd2-9456-bc11d98737ce in Status: IN_PROGRESS for 2s [ 716.898822] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27b85908-8ec4-43b9-a75f-406d0e56ea98 in Status: SUCCESS [ 716.898976] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27b85908-8ec4-43b9-a75f-406d0e56ea98 deletion is rescheduled due to dependency. [ 716.899094] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27b85908-8ec4-43b9-a75f-406d0e56ea98" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.981806] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 in Status: SUCCESS [ 716.982472] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.111800] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.113906] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.113906] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.113906] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.114146] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.115350] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.115550] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.115690] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.115946] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.116151] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.116337] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78f53cda-281e-4098-b286-926afd0b084e is going to be updated. [ 717.151698] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.151913] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.151987] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.152240] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.152401] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.157767] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-327 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.157767] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-327" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.157767] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-327" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.157767] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-327" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.158289] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.160187] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.160543] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.160766] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.161018] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.161328] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 717.161534] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 717.161657] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 717.161769] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 717.161938] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 717.162081] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 717.162978] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 717.166632] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78f53cda-281e-4098-b286-926afd0b084e in Status: IN_PROGRESS for 2s [ 717.189923] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 717.190200] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 717.190339] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 717.190628] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-327" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.191187] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-e0f60bab-f39a-4d81-9401-a60d4b813c5b taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.191187] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-e0f60bab-f39a-4d81-9401-a60d4b813c5b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.191332] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-e0f60bab-f39a-4d81-9401-a60d4b813c5b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.191670] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-e0f60bab-f39a-4d81-9401-a60d4b813c5b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.191842] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0f60bab-f39a-4d81-9401-a60d4b813c5b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.694102] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.694371] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.694539] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.694846] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.695048] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.695248] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port e0f60bab-f39a-4d81-9401-a60d4b813c5b not found, creating... [ 717.695604] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.695818] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.695980] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.696261] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.696471] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.696780] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.697027] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.697176] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.697433] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.697566] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.697675] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: e0f60bab-f39a-4d81-9401-a60d4b813c5b is going to be created. [ 717.727618] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.727898] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.727978] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.728320] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.728578] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.728815] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-e0f60bab-f39a-4d81-9401-a60d4b813c5b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.890251] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f293d027-3f3e-402a-bfe6-98af5d29163f in Status: SUCCESS [ 717.890736] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f293d027-3f3e-402a-bfe6-98af5d29163f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.471015] env[65943]: INFO networking_nsxv3.common.synchronization [req-78686ba9-38f7-46d6-8f81-d77431e9f696 req-f67230f4-5bdf-4750-9211-291fcfabaec0 service nova] Enqueued Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_rules [ 718.471221] env[65943]: INFO networking_nsxv3.common.synchronization [req-78686ba9-38f7-46d6-8f81-d77431e9f696 req-f67230f4-5bdf-4750-9211-291fcfabaec0 service nova] Enqueued Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_members [ 718.471365] env[65943]: INFO networking_nsxv3.common.synchronization [req-78686ba9-38f7-46d6-8f81-d77431e9f696 req-f67230f4-5bdf-4750-9211-291fcfabaec0 service nova] Enqueued Resource ID: e0f60bab-f39a-4d81-9401-a60d4b813c5b with Priority: HIGHEST for action port [ 718.471626] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_rules [ 718.471719] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_members [ 718.471810] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0f60bab-f39a-4d81-9401-a60d4b813c5b with Priority: HIGHEST for action port [ 718.472979] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9b127ff-135f-4cd2-9456-bc11d98737ce taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.473098] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.473189] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.473419] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.473537] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.475474] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b127ff-135f-4cd2-9456-bc11d98737ce taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.475837] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.475929] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0f60bab-f39a-4d81-9401-a60d4b813c5b taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.475999] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0f60bab-f39a-4d81-9401-a60d4b813c5b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.476167] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0f60bab-f39a-4d81-9401-a60d4b813c5b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.476370] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0f60bab-f39a-4d81-9401-a60d4b813c5b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.476455] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0f60bab-f39a-4d81-9401-a60d4b813c5b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.683035] env[65943]: INFO networking_nsxv3.common.synchronization [req-d56899f4-6895-44b8-a59d-f9454fd4b5ca req-3c7b08bb-471e-430c-8ad8-d7d6399852cb tempest-ImagesTestJSON-196343566 tempest-ImagesTestJSON-196343566-project-member] Enqueued Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_members [ 718.683035] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_members [ 718.683035] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c81f5e-9888-4914-ab90-42d06116db49 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.683035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.683035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.683035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.683035] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.683035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.683035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.683035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.683035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.683035] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.845487] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b127ff-135f-4cd2-9456-bc11d98737ce in Status: SUCCESS [ 718.845667] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9b127ff-135f-4cd2-9456-bc11d98737ce deletion is rescheduled due to dependency. [ 718.845781] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.845945] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.846262] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.846449] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.846567] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.846631] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.846783] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.846866] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.846960] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.977030] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b127ff-135f-4cd2-9456-bc11d98737ce taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.977030] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.979628] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e0f60bab-f39a-4d81-9401-a60d4b813c5b with status ACTIVE [ 718.979628] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.979628] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.979628] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.979628] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.979628] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.979980] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.979980] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.983645] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.983645] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.983645] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.983645] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.983645] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.983645] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.983645] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.983645] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.983645] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e0f60bab-f39a-4d81-9401-a60d4b813c5b is going to be updated. [ 719.005416] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.005654] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.005870] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.006403] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.006485] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.006671] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0f60bab-f39a-4d81-9401-a60d4b813c5b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.125419] env[65943]: INFO networking_nsxv3.common.synchronization [req-ac33f520-a028-4cb5-8481-0bcf895bbd06 req-3f4c3d00-2ad7-4cf7-b1ae-a9fb67a5f9a4 tempest-VolumesAssistedSnapshotsTest-1092122238 tempest-VolumesAssistedSnapshotsTest-1092122238-project-member] Enqueued Resource ID: d97ff6f8-41cc-4974-82fe-bda7247ceb2b with Priority: HIGHEST for action security_group_members [ 719.126179] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d97ff6f8-41cc-4974-82fe-bda7247ceb2b with Priority: HIGHEST for action security_group_members [ 719.126587] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-d97ff6f8-41cc-4974-82fe-bda7247ceb2b taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.126760] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d97ff6f8-41cc-4974-82fe-bda7247ceb2b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.126854] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d97ff6f8-41cc-4974-82fe-bda7247ceb2b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.127157] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d97ff6f8-41cc-4974-82fe-bda7247ceb2b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.127854] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.127854] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.127854] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.127854] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.127854] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.128150] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d97ff6f8-41cc-4974-82fe-bda7247ceb2b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.179713] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78f53cda-281e-4098-b286-926afd0b084e in Status: SUCCESS [ 719.180343] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78f53cda-281e-4098-b286-926afd0b084e deletion is rescheduled due to dependency. [ 719.180343] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78f53cda-281e-4098-b286-926afd0b084e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.191680] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.191847] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.191907] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.192499] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.192708] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.192975] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.193108] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.193272] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.193462] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.193558] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.193667] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c81f5e-9888-4914-ab90-42d06116db49 is going to be updated. [ 719.234745] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.235169] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.235399] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.235696] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.239019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.249134] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c81f5e-9888-4914-ab90-42d06116db49 in Status: IN_PROGRESS for 2s [ 719.349735] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.631047] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.631047] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.631047] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.631203] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.632071] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.632071] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.632071] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.632071] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.632071] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.632071] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.632071] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d97ff6f8-41cc-4974-82fe-bda7247ceb2b is going to be updated. [ 719.688408] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.688628] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.688715] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.688973] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.689140] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.701527] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d97ff6f8-41cc-4974-82fe-bda7247ceb2b in Status: IN_PROGRESS for 2s [ 719.854677] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.357790] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.359470] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.359470] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.359470] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.359470] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.359470] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9b127ff-135f-4cd2-9456-bc11d98737ce is going to be updated. [ 720.392060] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.392060] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.392060] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.392060] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.392060] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.401396] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b127ff-135f-4cd2-9456-bc11d98737ce in Status: IN_PROGRESS for 2s [ 721.260469] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c81f5e-9888-4914-ab90-42d06116db49 in Status: SUCCESS [ 721.260469] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c81f5e-9888-4914-ab90-42d06116db49 deletion is rescheduled due to dependency. [ 721.260641] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.476670] env[65943]: INFO networking_nsxv3.common.synchronization [req-d5899ec9-b23d-4f1a-95c8-75d8ada7330c req-0eba84bf-8aca-4eca-93fd-9c6fef0cc2a4 tempest-FloatingIPsAssociationTestJSON-462341531 tempest-FloatingIPsAssociationTestJSON-462341531-project-member] Enqueued Resource ID: 9a29bac0-8e63-4f6f-957d-9bd116500c7e with Priority: HIGHEST for action security_group_members [ 721.477282] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a29bac0-8e63-4f6f-957d-9bd116500c7e with Priority: HIGHEST for action security_group_members [ 721.477567] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a29bac0-8e63-4f6f-957d-9bd116500c7e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.477689] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.477846] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.477945] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.479355] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.479355] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.479355] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.479355] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.479355] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.479355] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a29bac0-8e63-4f6f-957d-9bd116500c7e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.716711] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d97ff6f8-41cc-4974-82fe-bda7247ceb2b in Status: SUCCESS [ 721.716890] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d97ff6f8-41cc-4974-82fe-bda7247ceb2b deletion is rescheduled due to dependency. [ 721.717031] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d97ff6f8-41cc-4974-82fe-bda7247ceb2b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.949041] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-334 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.949041] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-334" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.949041] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-334" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.949041] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-334" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.949336] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.949336] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.949336] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.949574] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.949749] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.949950] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 721.950076] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 721.950178] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 721.950275] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 721.950392] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 721.950489] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 721.950622] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 721.972865] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 721.973041] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 721.973172] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 721.973341] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-334" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.973640] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-d8711b7c-bbfe-4b4a-9f8b-b4013820a998 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.973799] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-d8711b7c-bbfe-4b4a-9f8b-b4013820a998" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.974502] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-d8711b7c-bbfe-4b4a-9f8b-b4013820a998" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.974902] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-d8711b7c-bbfe-4b4a-9f8b-b4013820a998" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.975130] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8711b7c-bbfe-4b4a-9f8b-b4013820a998',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.982197] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a29bac0-8e63-4f6f-957d-9bd116500c7e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.414747] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b127ff-135f-4cd2-9456-bc11d98737ce in Status: SUCCESS [ 722.414988] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.415193] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.415445] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.415650] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.415776] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.415831] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.415983] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.416105] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.416185] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.416295] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.478286] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.478652] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.478769] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.479461] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.479615] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.480535] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port d8711b7c-bbfe-4b4a-9f8b-b4013820a998 not found, creating... [ 722.480535] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.480715] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.480827] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.481261] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.481541] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.482093] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.482375] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.482597] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.484823] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.484823] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.484823] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: d8711b7c-bbfe-4b4a-9f8b-b4013820a998 is going to be created. [ 722.487327] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a29bac0-8e63-4f6f-957d-9bd116500c7e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.507115] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.507355] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.507526] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.507977] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.508378] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.508756] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-d8711b7c-bbfe-4b4a-9f8b-b4013820a998" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.921278] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b127ff-135f-4cd2-9456-bc11d98737ce taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.921615] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.921615] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.922197] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.922197] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.922197] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.922197] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.922197] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.922479] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.922479] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.922479] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b127ff-135f-4cd2-9456-bc11d98737ce taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.922565] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.922594] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.923156] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.923156] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.923156] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.923156] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.923156] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.923362] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.923362] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.923362] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.990051] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.990227] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.990505] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.990505] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.990640] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.990709] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a29bac0-8e63-4f6f-957d-9bd116500c7e is going to be updated. [ 723.021127] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.021127] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.021127] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.021127] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.021127] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.029566] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a29bac0-8e63-4f6f-957d-9bd116500c7e in Status: IN_PROGRESS for 2s [ 723.304032] env[65943]: INFO networking_nsxv3.common.synchronization [req-d5899ec9-b23d-4f1a-95c8-75d8ada7330c req-54c62323-1981-4514-9ae9-20255b6dc0e6 service nova] Enqueued Resource ID: 9a29bac0-8e63-4f6f-957d-9bd116500c7e with Priority: HIGHEST for action security_group_rules [ 723.304290] env[65943]: INFO networking_nsxv3.common.synchronization [req-d5899ec9-b23d-4f1a-95c8-75d8ada7330c req-54c62323-1981-4514-9ae9-20255b6dc0e6 service nova] Enqueued Resource ID: 9a29bac0-8e63-4f6f-957d-9bd116500c7e with Priority: HIGHEST for action security_group_members [ 723.304479] env[65943]: INFO networking_nsxv3.common.synchronization [req-d5899ec9-b23d-4f1a-95c8-75d8ada7330c req-54c62323-1981-4514-9ae9-20255b6dc0e6 service nova] Enqueued Resource ID: d8711b7c-bbfe-4b4a-9f8b-b4013820a998 with Priority: HIGHEST for action port [ 723.307421] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a29bac0-8e63-4f6f-957d-9bd116500c7e with Priority: HIGHEST for action security_group_rules [ 723.307616] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a29bac0-8e63-4f6f-957d-9bd116500c7e with Priority: HIGHEST for action security_group_members [ 723.307721] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8711b7c-bbfe-4b4a-9f8b-b4013820a998 with Priority: HIGHEST for action port [ 723.308138] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a29bac0-8e63-4f6f-957d-9bd116500c7e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.308334] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.308334] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.308599] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.308708] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a29bac0-8e63-4f6f-957d-9bd116500c7e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.310064] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a29bac0-8e63-4f6f-957d-9bd116500c7e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.310064] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.310064] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8711b7c-bbfe-4b4a-9f8b-b4013820a998 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.310330] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8711b7c-bbfe-4b4a-9f8b-b4013820a998" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.310330] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8711b7c-bbfe-4b4a-9f8b-b4013820a998" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.310503] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8711b7c-bbfe-4b4a-9f8b-b4013820a998" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.310503] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8711b7c-bbfe-4b4a-9f8b-b4013820a998',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.426199] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9b127ff-135f-4cd2-9456-bc11d98737ce: rpc.has_security_group_logging(os_id): False [ 723.451260] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.451543] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.451543] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.451677] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.451783] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.452013] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.452113] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.452171] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.452322] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.452402] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.452580] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.452672] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.452733] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.452870] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.452943] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.455870] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.455870] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.455870] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.455870] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.455870] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.455870] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9b127ff-135f-4cd2-9456-bc11d98737ce is going to be updated. [ 723.528986] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.528986] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.528986] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.528986] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.529461] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.549137] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9b127ff-135f-4cd2-9456-bc11d98737ce in Status: IN_PROGRESS for 2s [ 723.812621] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a29bac0-8e63-4f6f-957d-9bd116500c7e taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.812752] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.813102] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d8711b7c-bbfe-4b4a-9f8b-b4013820a998 with status ACTIVE [ 723.813307] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.813424] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.813507] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.813716] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.813860] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.814113] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.814197] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.814229] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.814390] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.814469] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.814793] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.814793] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.814793] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.814930] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.814998] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.815363] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d8711b7c-bbfe-4b4a-9f8b-b4013820a998 is going to be updated. [ 723.845188] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.845329] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.845400] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.845609] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.845746] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.845908] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8711b7c-bbfe-4b4a-9f8b-b4013820a998" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.041087] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a29bac0-8e63-4f6f-957d-9bd116500c7e in Status: SUCCESS [ 725.041087] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.041591] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.041847] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.042089] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.043377] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.043458] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.043639] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.043731] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.044056] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a29bac0-8e63-4f6f-957d-9bd116500c7e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.549130] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a29bac0-8e63-4f6f-957d-9bd116500c7e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.570118] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9b127ff-135f-4cd2-9456-bc11d98737ce in Status: SUCCESS [ 725.570118] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.661419] env[65943]: INFO networking_nsxv3.common.synchronization [req-8dd2c948-401b-4392-9723-f72d7da18b77 req-00473a92-ffc5-4540-af0a-55e1bab2225d tempest-ServersWithSpecificFlavorTestJSON-110328110 tempest-ServersWithSpecificFlavorTestJSON-110328110-project-member] Enqueued Resource ID: b88e0956-a799-4c5e-8e71-323151811fd1 with Priority: HIGHEST for action security_group_members [ 725.661998] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b88e0956-a799-4c5e-8e71-323151811fd1 with Priority: HIGHEST for action security_group_members [ 725.662313] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b88e0956-a799-4c5e-8e71-323151811fd1 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.662436] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.662501] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.662697] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.662844] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.663178] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.663178] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.663178] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.663430] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.663430] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b88e0956-a799-4c5e-8e71-323151811fd1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.054491] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a29bac0-8e63-4f6f-957d-9bd116500c7e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.165711] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.165901] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.165963] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.166309] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.166444] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.166740] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.166855] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.166953] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.167154] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.167259] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.167371] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b88e0956-a799-4c5e-8e71-323151811fd1 is going to be updated. [ 726.200052] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.200052] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.200052] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.200052] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.200052] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.211101] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b88e0956-a799-4c5e-8e71-323151811fd1 in Status: IN_PROGRESS for 2s [ 726.560544] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.561717] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.561717] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.561717] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.561717] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.565104] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a29bac0-8e63-4f6f-957d-9bd116500c7e is going to be updated. [ 726.609774] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.609774] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.609774] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.609774] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.609774] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.620722] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a29bac0-8e63-4f6f-957d-9bd116500c7e in Status: IN_PROGRESS for 2s [ 727.949499] env[65943]: INFO networking_nsxv3.common.synchronization [req-3e1a6e62-ec95-4825-88bd-08ab863ec828 req-55fbee13-2a6d-474c-a9f7-87827ff7b7ff tempest-InstanceActionsNegativeTestJSON-727219672 tempest-InstanceActionsNegativeTestJSON-727219672-project-member] Enqueued Resource ID: f293d027-3f3e-402a-bfe6-98af5d29163f with Priority: HIGHEST for action security_group_members [ 727.949499] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f293d027-3f3e-402a-bfe6-98af5d29163f with Priority: HIGHEST for action security_group_members [ 727.949499] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-f293d027-3f3e-402a-bfe6-98af5d29163f taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.949499] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f293d027-3f3e-402a-bfe6-98af5d29163f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.949499] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f293d027-3f3e-402a-bfe6-98af5d29163f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.949985] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f293d027-3f3e-402a-bfe6-98af5d29163f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.949985] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.949985] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.949985] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.951522] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.951619] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.951749] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f293d027-3f3e-402a-bfe6-98af5d29163f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.223505] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b88e0956-a799-4c5e-8e71-323151811fd1 in Status: SUCCESS [ 728.224275] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b88e0956-a799-4c5e-8e71-323151811fd1 deletion is rescheduled due to dependency. [ 728.224275] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.454880] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.455048] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.455113] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.455340] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.455432] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.455627] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.455836] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.455948] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.456207] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.456309] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.456406] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f293d027-3f3e-402a-bfe6-98af5d29163f is going to be updated. [ 728.488535] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.488710] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.488779] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.488995] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.489154] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.510067] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f293d027-3f3e-402a-bfe6-98af5d29163f in Status: IN_PROGRESS for 2s [ 728.634398] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a29bac0-8e63-4f6f-957d-9bd116500c7e in Status: SUCCESS [ 728.634398] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.634957] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.634957] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.635034] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.635143] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.635190] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.638950] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.639142] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.639315] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.639461] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9a29bac0-8e63-4f6f-957d-9bd116500c7e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.144495] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a29bac0-8e63-4f6f-957d-9bd116500c7e taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.144888] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.144888] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.145162] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.145392] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.145671] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.145736] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.145901] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.145993] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.145993] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.146287] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a29bac0-8e63-4f6f-957d-9bd116500c7e taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.146385] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.146448] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.146590] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.146729] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.146820] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.146879] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.147041] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.147139] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.147250] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.147340] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9a29bac0-8e63-4f6f-957d-9bd116500c7e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.650215] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9a29bac0-8e63-4f6f-957d-9bd116500c7e: rpc.has_security_group_logging(os_id): False [ 729.670220] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.670362] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.670413] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.670632] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.670730] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.672057] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.672410] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.672410] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.672497] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.672533] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.674278] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.674278] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.674278] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.674278] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.674278] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.674278] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.674278] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.674278] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.674278] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.674278] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.674278] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a29bac0-8e63-4f6f-957d-9bd116500c7e is going to be updated. [ 729.753174] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.753872] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.753872] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.754155] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.754362] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.768947] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a29bac0-8e63-4f6f-957d-9bd116500c7e in Status: IN_PROGRESS for 2s [ 730.110168] env[65943]: INFO networking_nsxv3.common.synchronization [None req-0f845f72-41b2-4ca8-9e38-ddd9d6801cc8 None None] Enqueued Resource ID: 3747b456-fb08-4e36-8530-c5663a2e116d with Priority: HIGHEST for action port [ 730.110737] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3747b456-fb08-4e36-8530-c5663a2e116d with Priority: HIGHEST for action port [ 730.111063] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-3747b456-fb08-4e36-8530-c5663a2e116d taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.111212] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3747b456-fb08-4e36-8530-c5663a2e116d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.111313] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3747b456-fb08-4e36-8530-c5663a2e116d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.111676] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3747b456-fb08-4e36-8530-c5663a2e116d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.111761] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3747b456-fb08-4e36-8530-c5663a2e116d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.507928] env[65943]: INFO networking_nsxv3.common.synchronization [None req-c8c8f7c0-52b7-4ad0-93bf-91e9ab4c8432 tempest-AttachInterfacesTestJSON-882476571 tempest-AttachInterfacesTestJSON-882476571-project-member] Enqueued Resource ID: 22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b with Priority: HIGHEST for action security_group_rules [ 730.508981] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b with Priority: HIGHEST for action security_group_rules [ 730.509963] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.510090] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.510806] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.510806] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.510806] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.525590] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f293d027-3f3e-402a-bfe6-98af5d29163f in Status: SUCCESS [ 730.525590] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f293d027-3f3e-402a-bfe6-98af5d29163f deletion is rescheduled due to dependency. [ 730.525590] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f293d027-3f3e-402a-bfe6-98af5d29163f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.607220] env[65943]: INFO networking_nsxv3.common.synchronization [None req-1f801ff3-4c79-4959-8dc6-51a44ffe20c3 tempest-AttachInterfacesTestJSON-882476571 tempest-AttachInterfacesTestJSON-882476571-project-member] Enqueued Resource ID: 22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b with Priority: HIGHEST for action security_group_rules [ 730.608113] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b with Priority: HIGHEST for action security_group_rules [ 730.608400] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.608515] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.614469] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3747b456-fb08-4e36-8530-c5663a2e116d [ 730.614469] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.614469] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.614469] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.614469] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.614469] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.614469] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3747b456-fb08-4e36-8530-c5663a2e116d already deleted. [ 730.614469] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3747b456-fb08-4e36-8530-c5663a2e116d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.042385] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.042517] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.042585] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.042804] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.042884] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.042979] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b already deleted. [ 731.043467] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.043467] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.043467] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.043467] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.568643] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.568928] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.568928] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.569879] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.570021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.570683] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b already deleted. [ 731.570683] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.782727] env[65943]: INFO networking_nsxv3.common.synchronization [None req-93011142-bb71-430a-9d7d-4b408cd61049 tempest-AttachVolumeShelveTestJSON-1945734723 tempest-AttachVolumeShelveTestJSON-1945734723-project-member] Enqueued Resource ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 with Priority: HIGHEST for action security_group_rules [ 731.785037] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a29bac0-8e63-4f6f-957d-9bd116500c7e in Status: SUCCESS [ 731.785037] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.785037] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 with Priority: HIGHEST for action security_group_rules [ 731.785037] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7544afbe-03f8-421e-b9ed-b038f61ffc17 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.785037] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.785037] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.785311] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.785311] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7544afbe-03f8-421e-b9ed-b038f61ffc17',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.932503] env[65943]: INFO networking_nsxv3.common.synchronization [None req-97b664f0-6b59-4f5a-b90e-2765e9dbf266 tempest-AttachVolumeShelveTestJSON-1945734723 tempest-AttachVolumeShelveTestJSON-1945734723-project-member] Enqueued Resource ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 with Priority: HIGHEST for action security_group_rules [ 731.932503] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 with Priority: HIGHEST for action security_group_rules [ 731.933012] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7544afbe-03f8-421e-b9ed-b038f61ffc17 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.933012] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.306509] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.307011] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.307224] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.307539] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.308025] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.308025] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 already deleted. [ 732.308025] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.308760] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.309936] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.309936] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7544afbe-03f8-421e-b9ed-b038f61ffc17',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.570957] env[65943]: INFO networking_nsxv3.common.synchronization [None req-79f486ad-5019-404a-9f09-ddcb678d1057 None None] Enqueued Resource ID: 73d5948d-57f3-4aa1-ba97-41e48b4c8985 with Priority: HIGHEST for action port [ 732.572287] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73d5948d-57f3-4aa1-ba97-41e48b4c8985 with Priority: HIGHEST for action port [ 732.572287] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-73d5948d-57f3-4aa1-ba97-41e48b4c8985 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.572287] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73d5948d-57f3-4aa1-ba97-41e48b4c8985" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.572767] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73d5948d-57f3-4aa1-ba97-41e48b4c8985" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.573086] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73d5948d-57f3-4aa1-ba97-41e48b4c8985" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.573238] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73d5948d-57f3-4aa1-ba97-41e48b4c8985',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.721657] env[65943]: INFO networking_nsxv3.common.synchronization [None req-769d545a-8ec2-449f-8d88-83fc943a2f46 None None] Enqueued Resource ID: 7abc480d-40aa-452f-8fd0-82f6348bd8d1 with Priority: HIGHEST for action port [ 732.722357] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7abc480d-40aa-452f-8fd0-82f6348bd8d1 with Priority: HIGHEST for action port [ 732.722951] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-7abc480d-40aa-452f-8fd0-82f6348bd8d1 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.723140] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7abc480d-40aa-452f-8fd0-82f6348bd8d1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.723244] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7abc480d-40aa-452f-8fd0-82f6348bd8d1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.723668] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7abc480d-40aa-452f-8fd0-82f6348bd8d1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.723728] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7abc480d-40aa-452f-8fd0-82f6348bd8d1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.832948] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.833268] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.833268] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.833421] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.836665] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.836665] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 already deleted. [ 732.836665] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.078113] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 73d5948d-57f3-4aa1-ba97-41e48b4c8985 [ 733.078383] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.078524] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.078643] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.078806] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.078895] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.079798] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:73d5948d-57f3-4aa1-ba97-41e48b4c8985 already deleted. [ 733.079928] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73d5948d-57f3-4aa1-ba97-41e48b4c8985" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.226938] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7abc480d-40aa-452f-8fd0-82f6348bd8d1 [ 733.227446] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.227446] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.227446] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.231489] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.231489] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.231489] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7abc480d-40aa-452f-8fd0-82f6348bd8d1 already deleted. [ 733.231489] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7abc480d-40aa-452f-8fd0-82f6348bd8d1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.263487] env[65943]: INFO networking_nsxv3.common.synchronization [req-2d53e94d-c80c-4756-b780-16ca6fe11dde req-7c284865-222c-449c-8599-049f34bed1e5 tempest-InstanceActionsTestJSON-1405464080 tempest-InstanceActionsTestJSON-1405464080-project-member] Enqueued Resource ID: f706a4bc-cb3d-42f0-9e3b-9871aac4d673 with Priority: HIGHEST for action security_group_members [ 734.264044] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f706a4bc-cb3d-42f0-9e3b-9871aac4d673 with Priority: HIGHEST for action security_group_members [ 734.264363] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-f706a4bc-cb3d-42f0-9e3b-9871aac4d673 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.264481] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f706a4bc-cb3d-42f0-9e3b-9871aac4d673" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.264544] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f706a4bc-cb3d-42f0-9e3b-9871aac4d673" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.264788] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f706a4bc-cb3d-42f0-9e3b-9871aac4d673" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.264936] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.265042] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.265552] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.265552] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.265552] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.265552] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f706a4bc-cb3d-42f0-9e3b-9871aac4d673',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.674158] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-627 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.674615] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-627" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.674615] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-627" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.675718] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-627" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.675718] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.675718] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.675718] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.676049] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.676049] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.676236] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 734.676344] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 734.676508] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 734.676555] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 734.676632] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 734.676858] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 734.676858] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 734.704316] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 734.704488] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 734.704764] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 734.704764] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-627" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.707573] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-68fa792c-e77f-46e6-aca6-3615977b581e taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.707790] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-68fa792c-e77f-46e6-aca6-3615977b581e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.707888] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-68fa792c-e77f-46e6-aca6-3615977b581e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.708242] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-68fa792c-e77f-46e6-aca6-3615977b581e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.708534] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68fa792c-e77f-46e6-aca6-3615977b581e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.768273] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.768437] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.768503] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.768700] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.768791] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.768975] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.769261] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.769261] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.769393] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.769503] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.769646] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f706a4bc-cb3d-42f0-9e3b-9871aac4d673 already deleted. [ 734.769728] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f706a4bc-cb3d-42f0-9e3b-9871aac4d673" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.873196] env[65943]: INFO networking_nsxv3.common.synchronization [None req-140246b7-4651-4b93-b059-59362734807c None None] Enqueued Resource ID: 16265477-f902-43dd-960b-b822c12e30f8 with Priority: HIGHEST for action port [ 734.873731] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16265477-f902-43dd-960b-b822c12e30f8 with Priority: HIGHEST for action port [ 734.874116] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-16265477-f902-43dd-960b-b822c12e30f8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.874348] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16265477-f902-43dd-960b-b822c12e30f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.874781] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16265477-f902-43dd-960b-b822c12e30f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.875271] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16265477-f902-43dd-960b-b822c12e30f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.875271] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16265477-f902-43dd-960b-b822c12e30f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.210466] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.210673] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.210790] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.211156] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.211221] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.211395] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port 68fa792c-e77f-46e6-aca6-3615977b581e not found, creating... [ 735.211642] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.211787] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.211872] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.212286] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.212286] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.212470] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.212694] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.212746] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.213037] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.213037] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.213558] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: 68fa792c-e77f-46e6-aca6-3615977b581e is going to be created. [ 735.233594] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.233858] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.233933] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.234220] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.234480] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.234690] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-68fa792c-e77f-46e6-aca6-3615977b581e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.377779] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 16265477-f902-43dd-960b-b822c12e30f8 [ 735.378047] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.378232] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.378232] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.378643] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.378757] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.379498] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:16265477-f902-43dd-960b-b822c12e30f8 already deleted. [ 735.379498] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16265477-f902-43dd-960b-b822c12e30f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.988121] env[65943]: INFO networking_nsxv3.common.synchronization [req-2d53e94d-c80c-4756-b780-16ca6fe11dde req-9636de58-2750-434e-a14f-630bfc96accb service nova] Enqueued Resource ID: f706a4bc-cb3d-42f0-9e3b-9871aac4d673 with Priority: HIGHEST for action security_group_rules [ 735.988295] env[65943]: INFO networking_nsxv3.common.synchronization [req-2d53e94d-c80c-4756-b780-16ca6fe11dde req-9636de58-2750-434e-a14f-630bfc96accb service nova] Enqueued Resource ID: f706a4bc-cb3d-42f0-9e3b-9871aac4d673 with Priority: HIGHEST for action security_group_members [ 735.988427] env[65943]: INFO networking_nsxv3.common.synchronization [req-2d53e94d-c80c-4756-b780-16ca6fe11dde req-9636de58-2750-434e-a14f-630bfc96accb service nova] Enqueued Resource ID: 68fa792c-e77f-46e6-aca6-3615977b581e with Priority: HIGHEST for action port [ 735.988674] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f706a4bc-cb3d-42f0-9e3b-9871aac4d673 with Priority: HIGHEST for action security_group_rules [ 735.988805] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f706a4bc-cb3d-42f0-9e3b-9871aac4d673 with Priority: HIGHEST for action security_group_members [ 735.988899] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68fa792c-e77f-46e6-aca6-3615977b581e with Priority: HIGHEST for action port [ 735.990621] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f706a4bc-cb3d-42f0-9e3b-9871aac4d673 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.990621] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f706a4bc-cb3d-42f0-9e3b-9871aac4d673" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.990621] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f706a4bc-cb3d-42f0-9e3b-9871aac4d673" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.990621] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f706a4bc-cb3d-42f0-9e3b-9871aac4d673" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.990621] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f706a4bc-cb3d-42f0-9e3b-9871aac4d673',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.991050] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-f706a4bc-cb3d-42f0-9e3b-9871aac4d673 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.991170] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f706a4bc-cb3d-42f0-9e3b-9871aac4d673" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.991235] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f706a4bc-cb3d-42f0-9e3b-9871aac4d673" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.991412] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f706a4bc-cb3d-42f0-9e3b-9871aac4d673" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.991564] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.991656] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.991714] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.991847] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.991972] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.992031] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f706a4bc-cb3d-42f0-9e3b-9871aac4d673',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.992966] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-68fa792c-e77f-46e6-aca6-3615977b581e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.993209] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68fa792c-e77f-46e6-aca6-3615977b581e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.993315] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68fa792c-e77f-46e6-aca6-3615977b581e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.993525] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68fa792c-e77f-46e6-aca6-3615977b581e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.993634] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68fa792c-e77f-46e6-aca6-3615977b581e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.498156] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f706a4bc-cb3d-42f0-9e3b-9871aac4d673',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.498156] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-f706a4bc-cb3d-42f0-9e3b-9871aac4d673 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.498156] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f706a4bc-cb3d-42f0-9e3b-9871aac4d673" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.498156] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 68fa792c-e77f-46e6-aca6-3615977b581e with status ACTIVE [ 736.498156] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.498156] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.498156] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.498634] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.498634] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.498634] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.498855] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.499413] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.499615] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.499775] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.499878] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.500065] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.500133] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.500277] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.500348] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.500429] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 68fa792c-e77f-46e6-aca6-3615977b581e is going to be updated. [ 736.524503] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.524646] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.524765] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.524931] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.525081] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.525243] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68fa792c-e77f-46e6-aca6-3615977b581e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.842936] env[65943]: INFO networking_nsxv3.common.synchronization [req-bce80695-7e6d-49e6-a972-76adfd5dd7c2 req-227c07f6-9378-44a7-a5fa-05918c228b88 tempest-ServerMetadataNegativeTestJSON-1273677523 tempest-ServerMetadataNegativeTestJSON-1273677523-project-member] Enqueued Resource ID: 68884628-4b38-403c-8fad-e29dfea783b0 with Priority: HIGHEST for action security_group_members [ 736.842936] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68884628-4b38-403c-8fad-e29dfea783b0 with Priority: HIGHEST for action security_group_members [ 736.843188] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-68884628-4b38-403c-8fad-e29dfea783b0 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.843302] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68884628-4b38-403c-8fad-e29dfea783b0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.843360] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68884628-4b38-403c-8fad-e29dfea783b0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.843605] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68884628-4b38-403c-8fad-e29dfea783b0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.843763] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.843863] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.843922] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.845386] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.845549] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.845671] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68884628-4b38-403c-8fad-e29dfea783b0',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.003071] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f706a4bc-cb3d-42f0-9e3b-9871aac4d673',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.347904] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.348086] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.348201] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.348406] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.348549] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.348709] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.348826] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.348891] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.349064] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.349150] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.349236] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68884628-4b38-403c-8fad-e29dfea783b0 already deleted. [ 737.349316] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68884628-4b38-403c-8fad-e29dfea783b0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.352536] env[65943]: INFO networking_nsxv3.common.synchronization [None req-0bf910b7-52c7-41e9-a0cc-7482a3eacf93 None None] Enqueued Resource ID: 54be3e67-1718-4621-9d88-35b1df208444 with Priority: HIGHEST for action port [ 737.353750] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54be3e67-1718-4621-9d88-35b1df208444 with Priority: HIGHEST for action port [ 737.355291] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-54be3e67-1718-4621-9d88-35b1df208444 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.355511] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54be3e67-1718-4621-9d88-35b1df208444" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.355627] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54be3e67-1718-4621-9d88-35b1df208444" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.355850] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54be3e67-1718-4621-9d88-35b1df208444" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.356315] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54be3e67-1718-4621-9d88-35b1df208444',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.383369] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-649 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.383594] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-649" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.383742] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-649" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.384095] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-649" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.384378] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.384560] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.384699] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.384938] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.385411] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.385650] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 737.385785] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 737.386116] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 737.386116] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 737.386213] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 737.386327] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 737.386485] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 737.406542] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 737.406677] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 737.406810] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 737.406974] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-649" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.407320] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-2811b356-8e1f-46cb-a430-52dddb4f27ae taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.409467] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-2811b356-8e1f-46cb-a430-52dddb4f27ae" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.409467] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-2811b356-8e1f-46cb-a430-52dddb4f27ae" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.409467] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-2811b356-8e1f-46cb-a430-52dddb4f27ae" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.409467] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2811b356-8e1f-46cb-a430-52dddb4f27ae',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.508742] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.508742] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.508742] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.509928] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.509928] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.509991] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f706a4bc-cb3d-42f0-9e3b-9871aac4d673 is going to be created. [ 737.536903] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.537096] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.537167] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.537391] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.537884] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.548653] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f706a4bc-cb3d-42f0-9e3b-9871aac4d673 in Status: UNINITIALIZED for 2s [ 737.859921] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 54be3e67-1718-4621-9d88-35b1df208444 [ 737.860175] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.860329] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.860416] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.860632] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.860966] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.860966] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:54be3e67-1718-4621-9d88-35b1df208444 already deleted. [ 737.860966] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54be3e67-1718-4621-9d88-35b1df208444" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.913129] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.913366] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.913481] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.913816] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.914015] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.914238] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port 2811b356-8e1f-46cb-a430-52dddb4f27ae not found, creating... [ 737.914590] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.914815] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.914970] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.915218] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.915354] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.915630] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.915780] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.915888] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.916327] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.916520] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.916704] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: 2811b356-8e1f-46cb-a430-52dddb4f27ae is going to be created. [ 737.938171] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.938495] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.938643] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.938910] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.939148] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.939373] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-2811b356-8e1f-46cb-a430-52dddb4f27ae" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.687157] env[65943]: INFO networking_nsxv3.common.synchronization [req-bce80695-7e6d-49e6-a972-76adfd5dd7c2 req-e2ad1fcf-de53-44d1-aea8-dc3148d5c4ac service nova] Enqueued Resource ID: 68884628-4b38-403c-8fad-e29dfea783b0 with Priority: HIGHEST for action security_group_rules [ 738.687409] env[65943]: INFO networking_nsxv3.common.synchronization [req-bce80695-7e6d-49e6-a972-76adfd5dd7c2 req-e2ad1fcf-de53-44d1-aea8-dc3148d5c4ac service nova] Enqueued Resource ID: 68884628-4b38-403c-8fad-e29dfea783b0 with Priority: HIGHEST for action security_group_members [ 738.687861] env[65943]: INFO networking_nsxv3.common.synchronization [req-bce80695-7e6d-49e6-a972-76adfd5dd7c2 req-e2ad1fcf-de53-44d1-aea8-dc3148d5c4ac service nova] Enqueued Resource ID: 2811b356-8e1f-46cb-a430-52dddb4f27ae with Priority: HIGHEST for action port [ 738.688955] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68884628-4b38-403c-8fad-e29dfea783b0 with Priority: HIGHEST for action security_group_rules [ 738.688955] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68884628-4b38-403c-8fad-e29dfea783b0 with Priority: HIGHEST for action security_group_members [ 738.689029] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2811b356-8e1f-46cb-a430-52dddb4f27ae with Priority: HIGHEST for action port [ 738.689317] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68884628-4b38-403c-8fad-e29dfea783b0 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.689519] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68884628-4b38-403c-8fad-e29dfea783b0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.689586] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68884628-4b38-403c-8fad-e29dfea783b0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.689836] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68884628-4b38-403c-8fad-e29dfea783b0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.689920] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68884628-4b38-403c-8fad-e29dfea783b0',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.691191] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-68884628-4b38-403c-8fad-e29dfea783b0 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.691307] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68884628-4b38-403c-8fad-e29dfea783b0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.691409] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68884628-4b38-403c-8fad-e29dfea783b0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.691539] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68884628-4b38-403c-8fad-e29dfea783b0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.691681] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.691772] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.691829] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.691959] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.692053] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.692143] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68884628-4b38-403c-8fad-e29dfea783b0',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.692896] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-2811b356-8e1f-46cb-a430-52dddb4f27ae taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.693011] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2811b356-8e1f-46cb-a430-52dddb4f27ae" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.693086] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2811b356-8e1f-46cb-a430-52dddb4f27ae" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.693263] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2811b356-8e1f-46cb-a430-52dddb4f27ae" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.693409] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2811b356-8e1f-46cb-a430-52dddb4f27ae',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.195334] env[65943]: INFO networking_nsxv3.common.synchronization [None req-c6d17710-9275-4048-bf3e-91c9898fd8a3 None None] Enqueued Resource ID: 3387a9fb-d92c-4cc1-9a1f-dd7b619ab348 with Priority: HIGHEST for action port [ 739.195334] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3387a9fb-d92c-4cc1-9a1f-dd7b619ab348 with Priority: HIGHEST for action port [ 739.195583] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-3387a9fb-d92c-4cc1-9a1f-dd7b619ab348 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.195713] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3387a9fb-d92c-4cc1-9a1f-dd7b619ab348" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.195789] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3387a9fb-d92c-4cc1-9a1f-dd7b619ab348" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.196095] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3387a9fb-d92c-4cc1-9a1f-dd7b619ab348" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.196187] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3387a9fb-d92c-4cc1-9a1f-dd7b619ab348',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.197274] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-68884628-4b38-403c-8fad-e29dfea783b0 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.198044] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68884628-4b38-403c-8fad-e29dfea783b0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.198044] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68884628-4b38-403c-8fad-e29dfea783b0',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.199729] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2811b356-8e1f-46cb-a430-52dddb4f27ae with status ACTIVE [ 739.199926] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.200082] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.200139] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.200302] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.200396] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.200571] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.200813] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.200813] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.200914] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.200958] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.202212] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.202212] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.202212] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.202212] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.202212] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.202212] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2811b356-8e1f-46cb-a430-52dddb4f27ae is going to be updated. [ 739.229303] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.229543] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.229685] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.230011] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.230251] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.230448] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2811b356-8e1f-46cb-a430-52dddb4f27ae" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.336237] env[65943]: INFO networking_nsxv3.common.synchronization [req-15d776b6-2b4d-4ade-8ac5-19de87881bf9 req-a0e2bd19-1808-494d-a3d0-65dd49c202dc tempest-MigrationsAdminTest-607423609 tempest-MigrationsAdminTest-607423609-project-member] Enqueued Resource ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a with Priority: HIGHEST for action security_group_members [ 739.336237] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a with Priority: HIGHEST for action security_group_members [ 739.337080] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.337415] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.338025] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.339359] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.339359] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.340317] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.342084] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.342084] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.342084] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.342084] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.557915] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f706a4bc-cb3d-42f0-9e3b-9871aac4d673 in Status: SUCCESS [ 739.558417] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f706a4bc-cb3d-42f0-9e3b-9871aac4d673" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.558417] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f706a4bc-cb3d-42f0-9e3b-9871aac4d673" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.558529] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f706a4bc-cb3d-42f0-9e3b-9871aac4d673" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.558757] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.558861] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.558923] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.559094] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.559181] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.559291] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f706a4bc-cb3d-42f0-9e3b-9871aac4d673" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.559804] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f706a4bc-cb3d-42f0-9e3b-9871aac4d673',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.703790] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68884628-4b38-403c-8fad-e29dfea783b0',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.704926] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3387a9fb-d92c-4cc1-9a1f-dd7b619ab348 [ 739.705222] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.705389] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.705488] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.705760] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.705894] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.706029] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3387a9fb-d92c-4cc1-9a1f-dd7b619ab348 already deleted. [ 739.706139] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3387a9fb-d92c-4cc1-9a1f-dd7b619ab348" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.845326] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.845326] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.845326] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.845587] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.845629] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.845844] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.845944] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.846023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.846388] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.846388] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.846388] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a already deleted. [ 739.846493] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.867446] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-651 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.868415] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.868415] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.868415] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.868415] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.868415] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.868639] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.868716] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.868849] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.869079] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 739.869253] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 739.869309] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 739.869388] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 739.870184] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 739.870322] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 739.870453] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 739.891578] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 739.892521] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 739.892521] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 739.892521] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.892521] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-739eb88b-c0b7-4e20-8996-700f71abecb2 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.893509] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-739eb88b-c0b7-4e20-8996-700f71abecb2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.893649] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-739eb88b-c0b7-4e20-8996-700f71abecb2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.894165] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-739eb88b-c0b7-4e20-8996-700f71abecb2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.894347] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('739eb88b-c0b7-4e20-8996-700f71abecb2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.061746] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-f706a4bc-cb3d-42f0-9e3b-9871aac4d673 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.061900] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f706a4bc-cb3d-42f0-9e3b-9871aac4d673" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.062110] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f706a4bc-cb3d-42f0-9e3b-9871aac4d673" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.062274] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f706a4bc-cb3d-42f0-9e3b-9871aac4d673" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.063768] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.063768] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.063768] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.063768] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.063768] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.063768] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f706a4bc-cb3d-42f0-9e3b-9871aac4d673" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.063768] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-f706a4bc-cb3d-42f0-9e3b-9871aac4d673 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.063768] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f706a4bc-cb3d-42f0-9e3b-9871aac4d673" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.063768] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f706a4bc-cb3d-42f0-9e3b-9871aac4d673" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.063768] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f706a4bc-cb3d-42f0-9e3b-9871aac4d673" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.063768] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.063768] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.063768] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.064361] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.064361] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.064361] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f706a4bc-cb3d-42f0-9e3b-9871aac4d673" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.064361] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f706a4bc-cb3d-42f0-9e3b-9871aac4d673',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.207814] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.207977] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.208386] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.208679] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.208776] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.208919] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68884628-4b38-403c-8fad-e29dfea783b0 is going to be created. [ 740.237969] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.239024] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.239024] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.239024] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.239024] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.249953] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68884628-4b38-403c-8fad-e29dfea783b0 in Status: UNINITIALIZED for 2s [ 740.397927] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.399570] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.399570] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.399692] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.401625] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.401625] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port 739eb88b-c0b7-4e20-8996-700f71abecb2 not found, creating... [ 740.401625] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.401625] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.401625] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.401625] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.401625] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.401625] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.402355] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.402774] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.403233] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.405022] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.405022] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: 739eb88b-c0b7-4e20-8996-700f71abecb2 is going to be created. [ 740.437476] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.437795] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.437922] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.438304] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.438789] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.439099] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-739eb88b-c0b7-4e20-8996-700f71abecb2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.566599] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f706a4bc-cb3d-42f0-9e3b-9871aac4d673: rpc.has_security_group_logging(os_id): False [ 740.586964] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.587132] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.587508] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.587508] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.587508] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.587804] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.587804] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.587906] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.588026] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.589379] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.589718] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.589819] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.589819] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.591659] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.591659] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.591659] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.591659] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.591659] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.592238] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.592238] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.592238] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f706a4bc-cb3d-42f0-9e3b-9871aac4d673 is going to be created. [ 740.663315] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.663453] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.664151] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.664151] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.664151] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.683891] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f706a4bc-cb3d-42f0-9e3b-9871aac4d673 in Status: IN_PROGRESS for 2s [ 740.751626] env[65943]: INFO networking_nsxv3.common.synchronization [None req-0b0409b8-c12f-4199-b08c-e8ff781bd789 None None] Enqueued Resource ID: 27fe0cf4-2626-47a5-8da2-5cbb18a50b04 with Priority: HIGHEST for action port [ 740.753030] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27fe0cf4-2626-47a5-8da2-5cbb18a50b04 with Priority: HIGHEST for action port [ 740.753030] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-27fe0cf4-2626-47a5-8da2-5cbb18a50b04 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.753030] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27fe0cf4-2626-47a5-8da2-5cbb18a50b04" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.753030] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27fe0cf4-2626-47a5-8da2-5cbb18a50b04" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.753935] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27fe0cf4-2626-47a5-8da2-5cbb18a50b04" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.754087] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27fe0cf4-2626-47a5-8da2-5cbb18a50b04',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.259898] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 27fe0cf4-2626-47a5-8da2-5cbb18a50b04 [ 741.260408] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.260408] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.260408] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.260578] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.260639] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.260727] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:27fe0cf4-2626-47a5-8da2-5cbb18a50b04 already deleted. [ 741.260811] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27fe0cf4-2626-47a5-8da2-5cbb18a50b04" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.288805] env[65943]: INFO networking_nsxv3.common.synchronization [req-15d776b6-2b4d-4ade-8ac5-19de87881bf9 req-3f2a725c-249d-4e6f-96c7-091bded31431 service nova] Enqueued Resource ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a with Priority: HIGHEST for action security_group_rules [ 741.289348] env[65943]: INFO networking_nsxv3.common.synchronization [req-15d776b6-2b4d-4ade-8ac5-19de87881bf9 req-3f2a725c-249d-4e6f-96c7-091bded31431 service nova] Enqueued Resource ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a with Priority: HIGHEST for action security_group_members [ 741.289348] env[65943]: INFO networking_nsxv3.common.synchronization [req-15d776b6-2b4d-4ade-8ac5-19de87881bf9 req-3f2a725c-249d-4e6f-96c7-091bded31431 service nova] Enqueued Resource ID: 739eb88b-c0b7-4e20-8996-700f71abecb2 with Priority: HIGHEST for action port [ 741.289632] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a with Priority: HIGHEST for action security_group_rules [ 741.289790] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a with Priority: HIGHEST for action security_group_members [ 741.289859] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 739eb88b-c0b7-4e20-8996-700f71abecb2 with Priority: HIGHEST for action port [ 741.294189] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.294189] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.294189] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.294189] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.294189] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.294189] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.294189] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.294638] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.294638] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.294775] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.294835] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.294914] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.296403] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.296506] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.296605] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.297468] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-739eb88b-c0b7-4e20-8996-700f71abecb2 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.297795] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-739eb88b-c0b7-4e20-8996-700f71abecb2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.297795] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-739eb88b-c0b7-4e20-8996-700f71abecb2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.297795] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-739eb88b-c0b7-4e20-8996-700f71abecb2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.297916] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('739eb88b-c0b7-4e20-8996-700f71abecb2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.799320] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.799762] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.802017] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.803821] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 739eb88b-c0b7-4e20-8996-700f71abecb2 with status ACTIVE [ 741.803821] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.803821] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.803821] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.803821] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.804147] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.804147] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.804267] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.804341] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.804518] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.804594] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.804801] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.804898] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.805025] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.806372] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.806496] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.806590] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 739eb88b-c0b7-4e20-8996-700f71abecb2 is going to be updated. [ 741.842130] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.843141] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.843141] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.843141] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.843141] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.844012] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-739eb88b-c0b7-4e20-8996-700f71abecb2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.963736] env[65943]: INFO networking_nsxv3.common.synchronization [None req-2bb736e5-6dca-47e3-a3ad-ae55b1b68930 None None] Enqueued Resource ID: 74c15ac6-a852-4a73-9906-4d8309daab3b with Priority: HIGHEST for action port [ 741.964897] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74c15ac6-a852-4a73-9906-4d8309daab3b with Priority: HIGHEST for action port [ 741.966961] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-74c15ac6-a852-4a73-9906-4d8309daab3b taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.966961] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74c15ac6-a852-4a73-9906-4d8309daab3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.966961] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74c15ac6-a852-4a73-9906-4d8309daab3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.966961] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74c15ac6-a852-4a73-9906-4d8309daab3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.966961] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74c15ac6-a852-4a73-9906-4d8309daab3b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.263532] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68884628-4b38-403c-8fad-e29dfea783b0 in Status: SUCCESS [ 742.263803] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68884628-4b38-403c-8fad-e29dfea783b0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.263982] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68884628-4b38-403c-8fad-e29dfea783b0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.264659] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68884628-4b38-403c-8fad-e29dfea783b0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.264906] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.266976] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.266976] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.267126] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.267387] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.267387] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68884628-4b38-403c-8fad-e29dfea783b0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.267528] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('68884628-4b38-403c-8fad-e29dfea783b0',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.311239] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.469507] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 74c15ac6-a852-4a73-9906-4d8309daab3b [ 742.469795] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.469896] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.469960] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.472270] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.472420] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.472544] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:74c15ac6-a852-4a73-9906-4d8309daab3b already deleted. [ 742.472644] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74c15ac6-a852-4a73-9906-4d8309daab3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.703454] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f706a4bc-cb3d-42f0-9e3b-9871aac4d673 in Status: SUCCESS [ 742.703885] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f706a4bc-cb3d-42f0-9e3b-9871aac4d673" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.774515] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-68884628-4b38-403c-8fad-e29dfea783b0 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.774515] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68884628-4b38-403c-8fad-e29dfea783b0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.774515] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68884628-4b38-403c-8fad-e29dfea783b0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.774515] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68884628-4b38-403c-8fad-e29dfea783b0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.774515] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.774515] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.774515] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.774515] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.774515] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.774515] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68884628-4b38-403c-8fad-e29dfea783b0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.774515] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-68884628-4b38-403c-8fad-e29dfea783b0 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.774978] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68884628-4b38-403c-8fad-e29dfea783b0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.774978] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68884628-4b38-403c-8fad-e29dfea783b0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.774978] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68884628-4b38-403c-8fad-e29dfea783b0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.774978] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.775103] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.775164] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.775303] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.776236] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.776236] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68884628-4b38-403c-8fad-e29dfea783b0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.776236] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('68884628-4b38-403c-8fad-e29dfea783b0',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.813466] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.813879] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.813879] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.813879] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.814031] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.814205] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a is going to be created. [ 742.847319] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.847467] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.847523] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.847714] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.848179] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.860295] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a in Status: UNINITIALIZED for 2s [ 742.906915] env[65943]: INFO networking_nsxv3.common.synchronization [None req-d6a417e4-7966-4324-8df9-69213874c739 None None] Enqueued Resource ID: b125cf83-c9a9-4743-98f2-0b08f99df5fd with Priority: HIGHEST for action port [ 742.908290] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b125cf83-c9a9-4743-98f2-0b08f99df5fd with Priority: HIGHEST for action port [ 742.912706] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-b125cf83-c9a9-4743-98f2-0b08f99df5fd taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.912706] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b125cf83-c9a9-4743-98f2-0b08f99df5fd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.912706] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b125cf83-c9a9-4743-98f2-0b08f99df5fd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.912706] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b125cf83-c9a9-4743-98f2-0b08f99df5fd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.912706] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b125cf83-c9a9-4743-98f2-0b08f99df5fd',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.278684] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 68884628-4b38-403c-8fad-e29dfea783b0: rpc.has_security_group_logging(os_id): False [ 743.299588] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.299769] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.300324] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.300459] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.300794] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.300965] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.300965] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.300965] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.301149] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.301226] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.301410] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.301923] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.301923] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.301923] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.301923] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.301923] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.302615] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.302615] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.302615] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.302615] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.302815] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68884628-4b38-403c-8fad-e29dfea783b0 is going to be created. [ 743.366679] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.366927] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.366927] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.367158] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.367470] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.381633] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68884628-4b38-403c-8fad-e29dfea783b0 in Status: IN_PROGRESS for 2s [ 743.415448] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b125cf83-c9a9-4743-98f2-0b08f99df5fd [ 743.415733] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.415841] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.415897] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.417041] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.417041] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.417041] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b125cf83-c9a9-4743-98f2-0b08f99df5fd already deleted. [ 743.417041] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b125cf83-c9a9-4743-98f2-0b08f99df5fd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.872041] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a in Status: SUCCESS [ 744.872349] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.872446] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.872657] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.872857] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.872960] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.873036] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.873207] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.873278] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.873365] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.873455] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.984949] env[65943]: INFO networking_nsxv3.common.synchronization [req-7e34736f-d55e-4a4b-b805-2c0b4dbb1af9 req-90655865-fd39-4b93-a7a4-f4d07444b785 tempest-ServersTestFqdnHostnames-900375028 tempest-ServersTestFqdnHostnames-900375028-project-member] Enqueued Resource ID: bad8ffbf-a375-4ee1-b522-c5e84af1b840 with Priority: HIGHEST for action security_group_members [ 744.984949] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bad8ffbf-a375-4ee1-b522-c5e84af1b840 with Priority: HIGHEST for action security_group_members [ 744.984949] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-bad8ffbf-a375-4ee1-b522-c5e84af1b840 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.984949] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bad8ffbf-a375-4ee1-b522-c5e84af1b840" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.984949] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bad8ffbf-a375-4ee1-b522-c5e84af1b840" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.984949] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bad8ffbf-a375-4ee1-b522-c5e84af1b840" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.984949] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.984949] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.984949] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.984949] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.984949] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.984949] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bad8ffbf-a375-4ee1-b522-c5e84af1b840',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.376891] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.376891] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.376891] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.377134] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.380276] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.380276] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.380276] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.380276] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.380276] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.380276] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.380276] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.380276] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.380276] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.380276] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.380276] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.380276] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.380276] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.380276] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.380883] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.380883] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.380883] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.396161] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68884628-4b38-403c-8fad-e29dfea783b0 in Status: SUCCESS [ 745.396490] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68884628-4b38-403c-8fad-e29dfea783b0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.487717] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.487803] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.488070] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.488231] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.488396] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.489374] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.489374] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.489374] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.489374] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.489374] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.489703] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bad8ffbf-a375-4ee1-b522-c5e84af1b840 is going to be updated. [ 745.522242] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.522728] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.522817] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.523854] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.524080] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.536601] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bad8ffbf-a375-4ee1-b522-c5e84af1b840 in Status: IN_PROGRESS for 2s [ 745.884527] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a: rpc.has_security_group_logging(os_id): False [ 745.903164] env[65943]: INFO networking_nsxv3.common.synchronization [None req-e2981c16-c805-4a57-85cb-cfd5f77c45ac None None] Enqueued Resource ID: 9c391e27-7c9d-4cbe-b24d-3a5906675081 with Priority: HIGHEST for action port [ 745.903795] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c391e27-7c9d-4cbe-b24d-3a5906675081 with Priority: HIGHEST for action port [ 745.905064] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c391e27-7c9d-4cbe-b24d-3a5906675081 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.905258] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c391e27-7c9d-4cbe-b24d-3a5906675081" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.906171] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c391e27-7c9d-4cbe-b24d-3a5906675081" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.906534] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c391e27-7c9d-4cbe-b24d-3a5906675081" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.906738] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c391e27-7c9d-4cbe-b24d-3a5906675081',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.911041] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.911041] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.911041] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.911041] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.912101] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.912101] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.912101] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.912101] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.912101] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.912922] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.913219] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.913331] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.913400] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.914286] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.914286] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.914286] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.914286] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.914286] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.914510] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.914608] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.914792] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a is going to be created. [ 745.996857] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.997284] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.997435] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.997718] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.998866] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.029494] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a in Status: IN_PROGRESS for 2s [ 746.410632] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9c391e27-7c9d-4cbe-b24d-3a5906675081 [ 746.410883] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.411054] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.411112] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.411306] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.411396] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.411491] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9c391e27-7c9d-4cbe-b24d-3a5906675081 already deleted. [ 746.411568] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c391e27-7c9d-4cbe-b24d-3a5906675081" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.269089] env[65943]: INFO networking_nsxv3.common.synchronization [None req-c2e77fef-7d7b-4515-b923-69361ba0a329 None None] Enqueued Resource ID: 89264ac7-7077-455a-b145-9010ace5f807 with Priority: HIGHEST for action port [ 747.271504] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89264ac7-7077-455a-b145-9010ace5f807 with Priority: HIGHEST for action port [ 747.273495] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-89264ac7-7077-455a-b145-9010ace5f807 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.273495] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89264ac7-7077-455a-b145-9010ace5f807" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.273495] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89264ac7-7077-455a-b145-9010ace5f807" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.273495] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89264ac7-7077-455a-b145-9010ace5f807" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.273495] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89264ac7-7077-455a-b145-9010ace5f807',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.281379] env[65943]: INFO networking_nsxv3.common.synchronization [None req-1e66d607-2559-4aaa-9278-e953a09d49cf tempest-ServersV294TestFqdnHostnames-134123508 tempest-ServersV294TestFqdnHostnames-134123508-project-member] Enqueued Resource ID: 6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b with Priority: HIGHEST for action security_group_rules [ 747.282152] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b with Priority: HIGHEST for action security_group_rules [ 747.282486] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.282609] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.282689] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.282973] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.283072] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.548897] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bad8ffbf-a375-4ee1-b522-c5e84af1b840 in Status: SUCCESS [ 747.548897] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bad8ffbf-a375-4ee1-b522-c5e84af1b840 deletion is rescheduled due to dependency. [ 747.548897] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bad8ffbf-a375-4ee1-b522-c5e84af1b840" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.776193] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 89264ac7-7077-455a-b145-9010ace5f807 [ 747.777037] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.777037] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.777234] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.777679] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.777679] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.777679] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:89264ac7-7077-455a-b145-9010ace5f807 already deleted. [ 747.777679] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89264ac7-7077-455a-b145-9010ace5f807" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.809365] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.809365] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.809365] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.809365] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.809365] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.809658] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b already deleted. [ 747.809658] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.988707] env[65943]: INFO networking_nsxv3.common.synchronization [None req-ce576594-143b-430e-a6ec-1b5f0d1b021a tempest-ServersV294TestFqdnHostnames-134123508 tempest-ServersV294TestFqdnHostnames-134123508-project-member] Enqueued Resource ID: 6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b with Priority: HIGHEST for action security_group_rules [ 747.989326] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b with Priority: HIGHEST for action security_group_rules [ 747.989624] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.989767] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.989819] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.990119] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.990436] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.043382] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a in Status: SUCCESS [ 748.044021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.302116] env[65943]: INFO networking_nsxv3.common.synchronization [req-573b4b19-092b-4b26-9e4d-d3fb6a8f9432 req-4e9aa4ff-9ee8-4e8c-9cfe-78b79df5a87a tempest-ServersAdminNegativeTestJSON-33136479 tempest-ServersAdminNegativeTestJSON-33136479-project-member] Enqueued Resource ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 with Priority: HIGHEST for action security_group_members [ 748.303641] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 with Priority: HIGHEST for action security_group_members [ 748.303641] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-df0b5076-3338-4b40-9ce6-994130c4b8d2 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.303641] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.303641] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.303641] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.304091] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.304091] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.304091] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.304853] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.304853] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.304853] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df0b5076-3338-4b40-9ce6-994130c4b8d2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.512798] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.513141] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.513141] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.513323] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.513445] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.513546] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b already deleted. [ 748.513656] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.810651] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.810651] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.810651] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.810651] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.810651] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.810651] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.810651] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.810651] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.810651] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.810651] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.810651] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 is going to be updated. [ 748.844707] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.844925] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.845032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.845303] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.845492] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.857504] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 in Status: IN_PROGRESS for 2s [ 749.838996] env[65943]: INFO networking_nsxv3.common.synchronization [None req-29e76c57-3c9c-474f-8818-ae8ba9d05029 None None] Enqueued Resource ID: 0e9b9738-d70e-4883-80b5-af083a06463f with Priority: HIGHEST for action port [ 749.839569] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e9b9738-d70e-4883-80b5-af083a06463f with Priority: HIGHEST for action port [ 749.839857] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e9b9738-d70e-4883-80b5-af083a06463f taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.839987] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e9b9738-d70e-4883-80b5-af083a06463f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.845286] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e9b9738-d70e-4883-80b5-af083a06463f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.846262] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e9b9738-d70e-4883-80b5-af083a06463f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.846262] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e9b9738-d70e-4883-80b5-af083a06463f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.350902] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0e9b9738-d70e-4883-80b5-af083a06463f [ 750.350902] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.350902] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.350902] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.350902] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.350902] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.350902] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0e9b9738-d70e-4883-80b5-af083a06463f already deleted. [ 750.350902] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e9b9738-d70e-4883-80b5-af083a06463f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.872658] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 in Status: SUCCESS [ 750.872658] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 deletion is rescheduled due to dependency. [ 750.872658] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.146041] env[65943]: INFO networking_nsxv3.common.synchronization [None req-e58d3019-4b33-4250-8048-386c318c8d31 None None] Enqueued Resource ID: ccf40f71-a9ac-4a79-b4fd-2d9dcf33060c with Priority: HIGHEST for action port [ 752.146618] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccf40f71-a9ac-4a79-b4fd-2d9dcf33060c with Priority: HIGHEST for action port [ 752.146913] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-ccf40f71-a9ac-4a79-b4fd-2d9dcf33060c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.147077] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ccf40f71-a9ac-4a79-b4fd-2d9dcf33060c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.147122] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ccf40f71-a9ac-4a79-b4fd-2d9dcf33060c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.147460] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ccf40f71-a9ac-4a79-b4fd-2d9dcf33060c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.147777] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccf40f71-a9ac-4a79-b4fd-2d9dcf33060c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.653484] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ccf40f71-a9ac-4a79-b4fd-2d9dcf33060c [ 752.653814] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.653969] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.654098] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.654320] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.654425] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.654528] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ccf40f71-a9ac-4a79-b4fd-2d9dcf33060c already deleted. [ 752.654662] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ccf40f71-a9ac-4a79-b4fd-2d9dcf33060c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.905788] env[65943]: INFO networking_nsxv3.common.synchronization [req-c0530232-adc3-49ca-afde-201f6a730221 req-373278cd-0fd2-436a-ab2f-58b7dfdc8388 tempest-ImagesTestJSON-196343566 tempest-ImagesTestJSON-196343566-project-member] Enqueued Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_members [ 754.906221] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_members [ 754.906733] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c81f5e-9888-4914-ab90-42d06116db49 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.906860] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.906928] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.907312] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.907471] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.907612] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.907652] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.907796] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.907881] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.907974] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.036934] env[65943]: INFO networking_nsxv3.common.synchronization [None req-aeec38c5-8163-492d-959d-952fb5a7b53f None None] Enqueued Resource ID: b12779a0-f7ae-43f7-b085-eb5396704018 with Priority: HIGHEST for action port [ 755.037606] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b12779a0-f7ae-43f7-b085-eb5396704018 with Priority: HIGHEST for action port [ 755.037955] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-b12779a0-f7ae-43f7-b085-eb5396704018 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.038378] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b12779a0-f7ae-43f7-b085-eb5396704018" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.038378] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b12779a0-f7ae-43f7-b085-eb5396704018" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.038610] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b12779a0-f7ae-43f7-b085-eb5396704018" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.038610] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b12779a0-f7ae-43f7-b085-eb5396704018',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.338015] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-40 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.338015] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-40" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.338015] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-40" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.338015] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-40" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.338255] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.338444] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.338698] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.338698] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.338995] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.339085] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 755.339143] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 755.339284] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 755.339336] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 755.339460] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 755.339595] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 755.339863] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 755.361770] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 755.361934] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 755.362084] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 755.362257] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-40" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.362686] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-0c934c3a-5f8e-4b1d-9af3-fd66752ff560 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.362800] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-0c934c3a-5f8e-4b1d-9af3-fd66752ff560" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.362874] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-0c934c3a-5f8e-4b1d-9af3-fd66752ff560" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.363315] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-0c934c3a-5f8e-4b1d-9af3-fd66752ff560" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.363446] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c934c3a-5f8e-4b1d-9af3-fd66752ff560',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.410410] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.410570] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.410643] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.410857] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.410950] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.411157] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.411253] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.411312] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.411458] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.411529] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.411614] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c81f5e-9888-4914-ab90-42d06116db49 is going to be updated. [ 755.441627] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.441627] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.441627] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.441627] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.441627] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.451504] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c81f5e-9888-4914-ab90-42d06116db49 in Status: IN_PROGRESS for 2s [ 755.541122] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b12779a0-f7ae-43f7-b085-eb5396704018 [ 755.541381] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.541516] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.541584] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.541799] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.541894] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.541990] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b12779a0-f7ae-43f7-b085-eb5396704018 already deleted. [ 755.542085] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b12779a0-f7ae-43f7-b085-eb5396704018" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.866016] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.866262] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.866430] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.866707] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.866855] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.867019] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port 0c934c3a-5f8e-4b1d-9af3-fd66752ff560 not found, creating... [ 755.867275] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.867468] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.867581] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.867789] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.867922] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.868212] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.868366] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.868477] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.868675] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.868823] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.869093] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: 0c934c3a-5f8e-4b1d-9af3-fd66752ff560 is going to be created. [ 755.889898] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.890109] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.890227] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.890614] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.890702] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.890919] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-0c934c3a-5f8e-4b1d-9af3-fd66752ff560" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.575834] env[65943]: INFO networking_nsxv3.common.synchronization [req-c0530232-adc3-49ca-afde-201f6a730221 req-b3d8b6b7-ba1f-4392-8dfe-a549bc9c9a15 service nova] Enqueued Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_rules [ 756.576089] env[65943]: INFO networking_nsxv3.common.synchronization [req-c0530232-adc3-49ca-afde-201f6a730221 req-b3d8b6b7-ba1f-4392-8dfe-a549bc9c9a15 service nova] Enqueued Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_members [ 756.576213] env[65943]: INFO networking_nsxv3.common.synchronization [req-c0530232-adc3-49ca-afde-201f6a730221 req-b3d8b6b7-ba1f-4392-8dfe-a549bc9c9a15 service nova] Enqueued Resource ID: 0c934c3a-5f8e-4b1d-9af3-fd66752ff560 with Priority: HIGHEST for action port [ 756.576876] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_rules [ 756.577052] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_members [ 756.577190] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c934c3a-5f8e-4b1d-9af3-fd66752ff560 with Priority: HIGHEST for action port [ 756.577527] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0c81f5e-9888-4914-ab90-42d06116db49 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.577686] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.577785] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.577996] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.578115] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.578906] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c81f5e-9888-4914-ab90-42d06116db49 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.579042] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.579205] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c934c3a-5f8e-4b1d-9af3-fd66752ff560 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.579308] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c934c3a-5f8e-4b1d-9af3-fd66752ff560" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.579361] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c934c3a-5f8e-4b1d-9af3-fd66752ff560" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.579523] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c934c3a-5f8e-4b1d-9af3-fd66752ff560" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.579597] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c934c3a-5f8e-4b1d-9af3-fd66752ff560',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.083029] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0c934c3a-5f8e-4b1d-9af3-fd66752ff560 with status ACTIVE [ 757.083029] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.083029] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.083029] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.083532] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.083674] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.083910] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.084154] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.084215] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.084494] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.084613] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.084845] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.084987] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.085466] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.085466] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.085466] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.085466] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0c934c3a-5f8e-4b1d-9af3-fd66752ff560 is going to be updated. [ 757.086868] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c81f5e-9888-4914-ab90-42d06116db49 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.087456] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.110402] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.110578] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.110578] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.110742] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.110909] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.111136] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c934c3a-5f8e-4b1d-9af3-fd66752ff560" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.468468] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c81f5e-9888-4914-ab90-42d06116db49 in Status: SUCCESS [ 757.468657] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c81f5e-9888-4914-ab90-42d06116db49 deletion is rescheduled due to dependency. [ 757.469042] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.469182] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.469594] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.469735] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.469861] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.469921] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.470134] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.470245] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.470344] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.566237] env[65943]: INFO networking_nsxv3.common.synchronization [req-7c48d8db-2dfc-4987-992f-1ead3c1c3f90 req-50d24fba-4f02-4e11-90ac-57908a5f48a0 tempest-ListServerFiltersTestJSON-237143396 tempest-ListServerFiltersTestJSON-237143396-project-member] Enqueued Resource ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e with Priority: HIGHEST for action security_group_members [ 757.566237] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e with Priority: HIGHEST for action security_group_members [ 757.566237] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8fad12-41c9-413e-91de-8c1ff3cf914e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.566237] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.566237] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.566237] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.566545] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.566671] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.566717] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.566876] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.566980] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.567065] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d8fad12-41c9-413e-91de-8c1ff3cf914e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.973323] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.070028] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.070173] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.070244] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.071490] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.071490] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.071490] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.071490] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.071490] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.071490] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.071490] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.071490] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e already deleted. [ 758.071490] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.082124] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-233 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.082325] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-233" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.082435] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-233" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.082769] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-233" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.083046] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.083207] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.083318] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.083559] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.083729] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.083934] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 758.084049] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 758.084155] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 758.084258] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 758.084358] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 758.084488] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 758.084645] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 758.105193] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 758.105363] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 758.105497] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 758.105664] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-233" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.105972] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-f231a164-f6b2-4ea3-8eb2-642e9fa93c9a taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.106153] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-f231a164-f6b2-4ea3-8eb2-642e9fa93c9a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.106269] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-f231a164-f6b2-4ea3-8eb2-642e9fa93c9a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.106617] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-f231a164-f6b2-4ea3-8eb2-642e9fa93c9a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.106756] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f231a164-f6b2-4ea3-8eb2-642e9fa93c9a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.476021] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.611006] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.611006] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.611006] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.611006] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.611006] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.611006] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port f231a164-f6b2-4ea3-8eb2-642e9fa93c9a not found, creating... [ 758.611006] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.611621] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.611621] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.611621] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.611621] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.611879] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.612076] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.612142] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.612320] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.612444] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.612577] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: f231a164-f6b2-4ea3-8eb2-642e9fa93c9a is going to be created. [ 758.636874] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.637033] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.637130] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.637396] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.637637] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.637853] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-f231a164-f6b2-4ea3-8eb2-642e9fa93c9a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.979166] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.979653] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.979653] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.979794] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.979794] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.979897] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c81f5e-9888-4914-ab90-42d06116db49 is going to be updated. [ 759.034843] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.035093] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.035093] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.035325] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.035996] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.045858] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c81f5e-9888-4914-ab90-42d06116db49 in Status: IN_PROGRESS for 2s [ 759.795952] env[65943]: INFO networking_nsxv3.common.synchronization [req-7c48d8db-2dfc-4987-992f-1ead3c1c3f90 req-9bcdb07b-07e5-460d-b4b5-c4614cc6da49 service nova] Enqueued Resource ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e with Priority: HIGHEST for action security_group_rules [ 759.796129] env[65943]: INFO networking_nsxv3.common.synchronization [req-7c48d8db-2dfc-4987-992f-1ead3c1c3f90 req-9bcdb07b-07e5-460d-b4b5-c4614cc6da49 service nova] Enqueued Resource ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e with Priority: HIGHEST for action security_group_members [ 759.796235] env[65943]: INFO networking_nsxv3.common.synchronization [req-7c48d8db-2dfc-4987-992f-1ead3c1c3f90 req-9bcdb07b-07e5-460d-b4b5-c4614cc6da49 service nova] Enqueued Resource ID: f231a164-f6b2-4ea3-8eb2-642e9fa93c9a with Priority: HIGHEST for action port [ 759.796909] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e with Priority: HIGHEST for action security_group_rules [ 759.797078] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e with Priority: HIGHEST for action security_group_members [ 759.797188] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f231a164-f6b2-4ea3-8eb2-642e9fa93c9a with Priority: HIGHEST for action port [ 759.797485] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d8fad12-41c9-413e-91de-8c1ff3cf914e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.797704] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.797778] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.798054] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.798127] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d8fad12-41c9-413e-91de-8c1ff3cf914e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.798989] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8fad12-41c9-413e-91de-8c1ff3cf914e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.799126] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.799175] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.801399] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.801399] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.801399] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.801399] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.801399] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.801399] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.801399] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d8fad12-41c9-413e-91de-8c1ff3cf914e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.801399] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-f231a164-f6b2-4ea3-8eb2-642e9fa93c9a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.801399] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f231a164-f6b2-4ea3-8eb2-642e9fa93c9a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.802791] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f231a164-f6b2-4ea3-8eb2-642e9fa93c9a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.802791] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f231a164-f6b2-4ea3-8eb2-642e9fa93c9a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.803055] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f231a164-f6b2-4ea3-8eb2-642e9fa93c9a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.096459] env[65943]: INFO networking_nsxv3.common.synchronization [req-366de585-0aae-4820-bac0-2281cb7caf3d req-096a79d5-3120-4e15-865e-0c5d8c7ca184 tempest-FloatingIPsAssociationTestJSON-462341531 tempest-FloatingIPsAssociationTestJSON-462341531-project-member] Enqueued Resource ID: 9a29bac0-8e63-4f6f-957d-9bd116500c7e with Priority: HIGHEST for action security_group_members [ 760.097015] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a29bac0-8e63-4f6f-957d-9bd116500c7e with Priority: HIGHEST for action security_group_members [ 760.097325] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a29bac0-8e63-4f6f-957d-9bd116500c7e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.097467] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.097560] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.097766] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.097927] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.098430] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.098729] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.098826] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.098954] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.100016] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a29bac0-8e63-4f6f-957d-9bd116500c7e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.305106] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d8fad12-41c9-413e-91de-8c1ff3cf914e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.306754] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8fad12-41c9-413e-91de-8c1ff3cf914e taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.306754] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.306957] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f231a164-f6b2-4ea3-8eb2-642e9fa93c9a with status ACTIVE [ 760.307119] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.307229] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.307293] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.307582] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.309249] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.309249] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.309249] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.309249] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.309605] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.309605] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.309605] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.309718] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.309752] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.310316] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.310316] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.310316] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f231a164-f6b2-4ea3-8eb2-642e9fa93c9a is going to be updated. [ 760.333291] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.333580] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.333642] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.333808] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.333944] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.334116] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f231a164-f6b2-4ea3-8eb2-642e9fa93c9a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.602669] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a29bac0-8e63-4f6f-957d-9bd116500c7e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.807780] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d8fad12-41c9-413e-91de-8c1ff3cf914e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.825580] env[65943]: INFO networking_nsxv3.common.synchronization [req-c9891818-df04-49a5-b8ad-7404ac8579d8 req-1c9f09c2-5599-4eb7-bc1c-cf0786779f70 tempest-ListServerFiltersTestJSON-237143396 tempest-ListServerFiltersTestJSON-237143396-project-member] Enqueued Resource ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e with Priority: HIGHEST for action security_group_members [ 760.826147] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e with Priority: HIGHEST for action security_group_members [ 760.826477] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8fad12-41c9-413e-91de-8c1ff3cf914e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.826597] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.061030] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c81f5e-9888-4914-ab90-42d06116db49 in Status: SUCCESS [ 761.061030] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.061030] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.061030] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.061487] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.061761] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.061930] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.062200] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.062381] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.063432] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.063432] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.106748] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a29bac0-8e63-4f6f-957d-9bd116500c7e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.299646] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-233 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.299646] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-233" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.299858] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-233" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.300249] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-233" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.300576] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.300768] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.300914] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.301188] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.301375] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.301605] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 761.301736] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 761.302056] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 761.302192] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 761.302312] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 761.302434] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 761.302606] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 761.311181] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.311425] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.311548] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.311808] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.311926] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.312093] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e is going to be created. [ 761.327293] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 761.327293] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 761.327465] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 761.327789] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-233" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.328209] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-976d02e2-8ce8-4a89-9e0e-475887f8376a taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.328765] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-976d02e2-8ce8-4a89-9e0e-475887f8376a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.328765] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-976d02e2-8ce8-4a89-9e0e-475887f8376a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.329155] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-976d02e2-8ce8-4a89-9e0e-475887f8376a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.329432] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('976d02e2-8ce8-4a89-9e0e-475887f8376a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.340033] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.340195] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.340240] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.340546] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.340635] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.352374] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e in Status: UNINITIALIZED for 2s [ 761.566890] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c81f5e-9888-4914-ab90-42d06116db49 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.566890] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.566890] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.567045] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.567145] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.567244] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.567308] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.567447] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.567553] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.567634] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.567778] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c81f5e-9888-4914-ab90-42d06116db49 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.567868] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.567926] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.568078] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.568211] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.568297] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.568353] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.568483] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.568557] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.568633] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.568720] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.610867] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.610989] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.611058] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.611278] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.611371] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.611482] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a29bac0-8e63-4f6f-957d-9bd116500c7e is going to be updated. [ 761.642838] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.642838] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.642838] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.642838] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.642838] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.651285] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a29bac0-8e63-4f6f-957d-9bd116500c7e in Status: IN_PROGRESS for 2s [ 761.832795] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.832795] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.833109] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.833168] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.833330] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.833489] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port 976d02e2-8ce8-4a89-9e0e-475887f8376a not found, creating... [ 761.833852] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.833952] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.834342] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.834342] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.834460] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.835101] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.835101] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.835339] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.835762] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.835762] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.835956] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: 976d02e2-8ce8-4a89-9e0e-475887f8376a is going to be created. [ 761.857354] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.857599] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.857779] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.857988] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.858360] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.858442] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-976d02e2-8ce8-4a89-9e0e-475887f8376a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.071873] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0c81f5e-9888-4914-ab90-42d06116db49: rpc.has_security_group_logging(os_id): False [ 762.091529] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.091696] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.091696] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.092531] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.092531] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.092531] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.092531] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.092531] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.092531] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.092531] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.092927] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.092927] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.093021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.093311] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.093311] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.093562] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.093562] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.093562] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.093698] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.093737] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.093829] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0c81f5e-9888-4914-ab90-42d06116db49 is going to be updated. [ 762.176202] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.176930] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.177123] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.177418] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.177694] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.194141] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0c81f5e-9888-4914-ab90-42d06116db49 in Status: IN_PROGRESS for 2s [ 762.657660] env[65943]: INFO networking_nsxv3.common.synchronization [req-c9891818-df04-49a5-b8ad-7404ac8579d8 req-0d2a5d8d-f2f9-494f-a89e-a190622f039c service nova] Enqueued Resource ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e with Priority: HIGHEST for action security_group_rules [ 762.657878] env[65943]: INFO networking_nsxv3.common.synchronization [req-c9891818-df04-49a5-b8ad-7404ac8579d8 req-0d2a5d8d-f2f9-494f-a89e-a190622f039c service nova] Enqueued Resource ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e with Priority: HIGHEST for action security_group_members [ 762.658028] env[65943]: INFO networking_nsxv3.common.synchronization [req-c9891818-df04-49a5-b8ad-7404ac8579d8 req-0d2a5d8d-f2f9-494f-a89e-a190622f039c service nova] Enqueued Resource ID: 976d02e2-8ce8-4a89-9e0e-475887f8376a with Priority: HIGHEST for action port [ 762.658603] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e with Priority: HIGHEST for action security_group_rules [ 762.659728] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e with Priority: HIGHEST for action security_group_members [ 762.659877] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 976d02e2-8ce8-4a89-9e0e-475887f8376a with Priority: HIGHEST for action port [ 762.660200] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d8fad12-41c9-413e-91de-8c1ff3cf914e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.660369] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.660652] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8fad12-41c9-413e-91de-8c1ff3cf914e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.660782] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.660973] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-976d02e2-8ce8-4a89-9e0e-475887f8376a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.661095] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-976d02e2-8ce8-4a89-9e0e-475887f8376a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.661180] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-976d02e2-8ce8-4a89-9e0e-475887f8376a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.661354] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-976d02e2-8ce8-4a89-9e0e-475887f8376a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.661429] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('976d02e2-8ce8-4a89-9e0e-475887f8376a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.133576] env[65943]: INFO networking_nsxv3.common.synchronization [req-48b1a169-5289-4742-8111-511bf8a4a09b req-a765e7d5-8d71-4ff9-95d4-8ee83b152f3c tempest-ServersWithSpecificFlavorTestJSON-110328110 tempest-ServersWithSpecificFlavorTestJSON-110328110-project-member] Enqueued Resource ID: b88e0956-a799-4c5e-8e71-323151811fd1 with Priority: HIGHEST for action security_group_members [ 763.134186] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b88e0956-a799-4c5e-8e71-323151811fd1 with Priority: HIGHEST for action security_group_members [ 763.134506] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b88e0956-a799-4c5e-8e71-323151811fd1 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.134626] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.134684] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.134878] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.135161] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.135384] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.135384] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.135491] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.135572] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.135757] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b88e0956-a799-4c5e-8e71-323151811fd1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.163970] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 976d02e2-8ce8-4a89-9e0e-475887f8376a with status ACTIVE [ 763.164357] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.164530] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.164689] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.164887] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.165032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.165988] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.165988] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.165988] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.165988] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.165988] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.166236] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.166236] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.166236] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.166476] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.166587] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.166678] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 976d02e2-8ce8-4a89-9e0e-475887f8376a is going to be updated. [ 763.200415] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.200752] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.200752] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.200999] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.201310] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.201552] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-976d02e2-8ce8-4a89-9e0e-475887f8376a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.368119] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e in Status: SUCCESS [ 763.368734] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.369220] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.369543] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.369802] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.369976] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.370101] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.370310] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.370444] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.370581] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.370785] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3d8fad12-41c9-413e-91de-8c1ff3cf914e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.373428] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.373428] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.373428] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.373428] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.373428] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.373761] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.373898] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.376575] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d8fad12-41c9-413e-91de-8c1ff3cf914e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.602629] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-481 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.603287] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-481" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.603387] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-481" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.603661] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-481" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.604534] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.604534] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.604534] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.604534] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.604787] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.605067] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 763.605222] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 763.605602] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 763.605602] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 763.605602] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 763.605803] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 763.605990] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 763.624313] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 763.624467] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 763.624613] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 763.624788] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-481" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.625120] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-2ac675b7-4ec0-496b-aed0-fb28f0907fdd taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.625368] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-2ac675b7-4ec0-496b-aed0-fb28f0907fdd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.625436] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-2ac675b7-4ec0-496b-aed0-fb28f0907fdd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.625703] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-2ac675b7-4ec0-496b-aed0-fb28f0907fdd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.625836] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ac675b7-4ec0-496b-aed0-fb28f0907fdd',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.639156] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.639858] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.640483] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.640716] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.640827] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.641068] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.641180] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.641244] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.641427] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.641532] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.641696] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b88e0956-a799-4c5e-8e71-323151811fd1 is going to be updated. [ 763.661456] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a29bac0-8e63-4f6f-957d-9bd116500c7e in Status: SUCCESS [ 763.661792] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.676184] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.676370] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.676471] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.676788] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.676977] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.689409] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b88e0956-a799-4c5e-8e71-323151811fd1 in Status: IN_PROGRESS for 2s [ 763.879240] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8fad12-41c9-413e-91de-8c1ff3cf914e taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.879440] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.879739] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d8fad12-41c9-413e-91de-8c1ff3cf914e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.128071] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.128296] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.128416] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.128814] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.129013] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.129168] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port 2ac675b7-4ec0-496b-aed0-fb28f0907fdd not found, creating... [ 764.129427] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.129581] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.129704] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.129927] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.130072] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.130353] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.130501] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.130609] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.130811] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.130938] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.131114] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: 2ac675b7-4ec0-496b-aed0-fb28f0907fdd is going to be created. [ 764.155920] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.156148] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.156252] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.156667] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.156791] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.157043] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-2ac675b7-4ec0-496b-aed0-fb28f0907fdd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.210901] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0c81f5e-9888-4914-ab90-42d06116db49 in Status: SUCCESS [ 764.211290] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.381924] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d8fad12-41c9-413e-91de-8c1ff3cf914e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.884759] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.885020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.885162] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.885513] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.885663] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.885928] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e is going to be updated. [ 764.924538] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.924718] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.925267] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.925267] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.925267] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.935661] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e in Status: IN_PROGRESS for 2s [ 764.960590] env[65943]: INFO networking_nsxv3.common.synchronization [req-48b1a169-5289-4742-8111-511bf8a4a09b req-b80702c6-33be-435d-93af-dd534c41f384 service nova] Enqueued Resource ID: b88e0956-a799-4c5e-8e71-323151811fd1 with Priority: HIGHEST for action security_group_rules [ 764.961985] env[65943]: INFO networking_nsxv3.common.synchronization [req-48b1a169-5289-4742-8111-511bf8a4a09b req-b80702c6-33be-435d-93af-dd534c41f384 service nova] Enqueued Resource ID: b88e0956-a799-4c5e-8e71-323151811fd1 with Priority: HIGHEST for action security_group_members [ 764.961985] env[65943]: INFO networking_nsxv3.common.synchronization [req-48b1a169-5289-4742-8111-511bf8a4a09b req-b80702c6-33be-435d-93af-dd534c41f384 service nova] Enqueued Resource ID: 2ac675b7-4ec0-496b-aed0-fb28f0907fdd with Priority: HIGHEST for action port [ 764.961985] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b88e0956-a799-4c5e-8e71-323151811fd1 with Priority: HIGHEST for action security_group_rules [ 764.962094] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b88e0956-a799-4c5e-8e71-323151811fd1 with Priority: HIGHEST for action security_group_members [ 764.962854] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac675b7-4ec0-496b-aed0-fb28f0907fdd with Priority: HIGHEST for action port [ 764.962854] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b88e0956-a799-4c5e-8e71-323151811fd1 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.962854] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.962854] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.962854] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.962854] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b88e0956-a799-4c5e-8e71-323151811fd1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.964456] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b88e0956-a799-4c5e-8e71-323151811fd1 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.964456] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.964653] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ac675b7-4ec0-496b-aed0-fb28f0907fdd taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.964732] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ac675b7-4ec0-496b-aed0-fb28f0907fdd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.964818] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ac675b7-4ec0-496b-aed0-fb28f0907fdd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.964985] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ac675b7-4ec0-496b-aed0-fb28f0907fdd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.965088] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ac675b7-4ec0-496b-aed0-fb28f0907fdd',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.464654] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b88e0956-a799-4c5e-8e71-323151811fd1 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.465099] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.467309] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2ac675b7-4ec0-496b-aed0-fb28f0907fdd with status ACTIVE [ 765.467589] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.467722] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.467788] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.468043] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.468173] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.468360] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.468470] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.468563] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.468706] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.468854] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.469028] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.469100] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.469344] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.469344] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.469533] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.469533] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2ac675b7-4ec0-496b-aed0-fb28f0907fdd is going to be updated. [ 765.495668] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.495926] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.495926] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.496099] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.496245] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.496447] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ac675b7-4ec0-496b-aed0-fb28f0907fdd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.699671] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b88e0956-a799-4c5e-8e71-323151811fd1 in Status: SUCCESS [ 765.699927] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b88e0956-a799-4c5e-8e71-323151811fd1 deletion is rescheduled due to dependency. [ 765.700057] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.700223] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.700439] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.701340] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.702685] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.702685] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.702685] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.702685] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.702685] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b88e0956-a799-4c5e-8e71-323151811fd1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.705191] env[65943]: INFO networking_nsxv3.common.synchronization [req-90ef29fe-6cc0-4b81-a3cf-cf88042d3e1b req-f917d5d2-b91e-4935-b7ec-bcceb6fca4d1 tempest-ImagesOneServerNegativeTestJSON-477600040 tempest-ImagesOneServerNegativeTestJSON-477600040-project-member] Enqueued Resource ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d with Priority: HIGHEST for action security_group_members [ 765.705886] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d with Priority: HIGHEST for action security_group_members [ 765.705886] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b23ffb1-731f-42f8-bb4b-c106291be34d taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.706733] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.706733] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.706733] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.706733] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.706733] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.706733] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.706733] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.706972] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.706972] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b23ffb1-731f-42f8-bb4b-c106291be34d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.206589] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b88e0956-a799-4c5e-8e71-323151811fd1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.209593] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.209748] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.209813] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.210325] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.210325] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.210575] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.210575] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.210575] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.210764] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.210764] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.210863] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d is going to be updated. [ 766.213669] env[65943]: INFO networking_nsxv3.common.synchronization [req-9398f99b-68e9-49ce-b4b6-c5f009fc2f08 req-c4930302-a4aa-426a-8ed4-6296f31e117b tempest-ServerDiskConfigTestJSON-397438939 tempest-ServerDiskConfigTestJSON-397438939-project-member] Enqueued Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_members [ 766.214526] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_members [ 766.215222] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b127ff-135f-4cd2-9456-bc11d98737ce taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.215341] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.215401] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.215567] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.215849] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.215849] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.215931] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.216046] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.216180] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.216180] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.259481] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.259481] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.259481] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.259901] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.259901] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.273782] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d in Status: IN_PROGRESS for 2s [ 766.710143] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b88e0956-a799-4c5e-8e71-323151811fd1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.718931] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.719128] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.719170] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.719385] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.719480] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.719676] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.719779] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.719832] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.719975] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.720080] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.720150] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9b127ff-135f-4cd2-9456-bc11d98737ce is going to be updated. [ 766.782020] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.782020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.782020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.782020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.782020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.793832] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b127ff-135f-4cd2-9456-bc11d98737ce in Status: IN_PROGRESS for 2s [ 766.841873] env[65943]: INFO networking_nsxv3.common.synchronization [req-ab1f8963-e9aa-4abe-80ca-7932e6654f09 req-080829c1-42d9-4a92-aaba-3bcdf93dc055 tempest-InstanceActionsTestJSON-1405464080 tempest-InstanceActionsTestJSON-1405464080-project-member] Enqueued Resource ID: f706a4bc-cb3d-42f0-9e3b-9871aac4d673 with Priority: HIGHEST for action security_group_members [ 766.842267] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f706a4bc-cb3d-42f0-9e3b-9871aac4d673 with Priority: HIGHEST for action security_group_members [ 766.842571] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-f706a4bc-cb3d-42f0-9e3b-9871aac4d673 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.842883] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f706a4bc-cb3d-42f0-9e3b-9871aac4d673" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.842883] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f706a4bc-cb3d-42f0-9e3b-9871aac4d673" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.843464] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f706a4bc-cb3d-42f0-9e3b-9871aac4d673" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.843464] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.843615] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.843691] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.843845] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.843935] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.844041] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f706a4bc-cb3d-42f0-9e3b-9871aac4d673',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.909188] env[65943]: INFO networking_nsxv3.common.synchronization [req-a9c9810f-0f84-4370-838f-d1d36bec7048 req-79b4ef26-69fb-4951-b461-39d5b17141a5 tempest-ListServerFiltersTestJSON-237143396 tempest-ListServerFiltersTestJSON-237143396-project-member] Enqueued Resource ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e with Priority: HIGHEST for action security_group_members [ 766.910815] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e with Priority: HIGHEST for action security_group_members [ 766.911099] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8fad12-41c9-413e-91de-8c1ff3cf914e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.911279] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.947043] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e in Status: SUCCESS [ 766.949881] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.949997] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.951568] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.951756] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.951880] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.952815] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.952815] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.952815] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.952815] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d8fad12-41c9-413e-91de-8c1ff3cf914e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.215828] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.216058] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.216174] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.216493] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.216596] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.217096] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b88e0956-a799-4c5e-8e71-323151811fd1 is going to be updated. [ 767.256827] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.258072] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.258072] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.258274] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.260234] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.290330] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b88e0956-a799-4c5e-8e71-323151811fd1 in Status: IN_PROGRESS for 2s [ 767.347728] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.347985] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.348094] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.348289] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.348391] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.348634] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.348769] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.348846] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.349011] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.349103] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.349195] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f706a4bc-cb3d-42f0-9e3b-9871aac4d673 is going to be updated. [ 767.382365] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.382536] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.382608] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.382896] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.383513] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.394030] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f706a4bc-cb3d-42f0-9e3b-9871aac4d673 in Status: IN_PROGRESS for 2s [ 767.415226] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-233 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.415417] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-233" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.415635] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-233" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.415909] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-233" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.416184] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.416329] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.416434] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.416773] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.416923] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.417148] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 767.417275] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 767.417374] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 767.417553] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 767.417707] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 767.417843] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 767.417951] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 767.446208] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 767.446403] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 767.446597] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 767.446760] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-233" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.447089] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-b813a173-8617-4cd4-a1db-dfdd5e526098 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.447338] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-b813a173-8617-4cd4-a1db-dfdd5e526098" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.447412] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-b813a173-8617-4cd4-a1db-dfdd5e526098" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.447923] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-b813a173-8617-4cd4-a1db-dfdd5e526098" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.447978] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b813a173-8617-4cd4-a1db-dfdd5e526098',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.456151] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d8fad12-41c9-413e-91de-8c1ff3cf914e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.950886] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.951267] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.951267] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.951640] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.951825] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.952011] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port b813a173-8617-4cd4-a1db-dfdd5e526098 not found, creating... [ 767.952416] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.952514] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.952653] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.952945] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.953088] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.953666] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.953726] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.953895] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.954148] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.954285] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.954502] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: b813a173-8617-4cd4-a1db-dfdd5e526098 is going to be created. [ 767.958666] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d8fad12-41c9-413e-91de-8c1ff3cf914e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.976816] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.977077] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.977217] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.977862] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.978101] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.978325] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-b813a173-8617-4cd4-a1db-dfdd5e526098" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.283057] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d in Status: SUCCESS [ 768.283269] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d deletion is rescheduled due to dependency. [ 768.283391] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.463139] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.463139] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.463139] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.463139] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.463139] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.463139] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e is going to be updated. [ 768.493682] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.493682] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.493682] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.493682] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.493682] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.503608] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e in Status: IN_PROGRESS for 2s [ 768.726230] env[65943]: INFO networking_nsxv3.common.synchronization [req-a9c9810f-0f84-4370-838f-d1d36bec7048 req-96a0037a-d7cb-4151-9664-aa7e3270a021 service nova] Enqueued Resource ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e with Priority: HIGHEST for action security_group_rules [ 768.726436] env[65943]: INFO networking_nsxv3.common.synchronization [req-a9c9810f-0f84-4370-838f-d1d36bec7048 req-96a0037a-d7cb-4151-9664-aa7e3270a021 service nova] Enqueued Resource ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e with Priority: HIGHEST for action security_group_members [ 768.726684] env[65943]: INFO networking_nsxv3.common.synchronization [req-a9c9810f-0f84-4370-838f-d1d36bec7048 req-96a0037a-d7cb-4151-9664-aa7e3270a021 service nova] Enqueued Resource ID: b813a173-8617-4cd4-a1db-dfdd5e526098 with Priority: HIGHEST for action port [ 768.728060] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e with Priority: HIGHEST for action security_group_rules [ 768.728218] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e with Priority: HIGHEST for action security_group_members [ 768.728321] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b813a173-8617-4cd4-a1db-dfdd5e526098 with Priority: HIGHEST for action port [ 768.728624] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d8fad12-41c9-413e-91de-8c1ff3cf914e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.728724] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.728923] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8fad12-41c9-413e-91de-8c1ff3cf914e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.729008] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.729188] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-b813a173-8617-4cd4-a1db-dfdd5e526098 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.730130] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b813a173-8617-4cd4-a1db-dfdd5e526098" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.730272] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b813a173-8617-4cd4-a1db-dfdd5e526098" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.730462] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b813a173-8617-4cd4-a1db-dfdd5e526098" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.730574] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b813a173-8617-4cd4-a1db-dfdd5e526098',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.803960] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b127ff-135f-4cd2-9456-bc11d98737ce in Status: SUCCESS [ 768.804123] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9b127ff-135f-4cd2-9456-bc11d98737ce deletion is rescheduled due to dependency. [ 768.804235] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.232824] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b813a173-8617-4cd4-a1db-dfdd5e526098 with status ACTIVE [ 769.233713] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.233713] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.233713] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.234240] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.234441] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.234888] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.234888] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.234888] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.235318] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.235318] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.236062] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.236062] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.236062] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.236062] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.236062] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.236062] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b813a173-8617-4cd4-a1db-dfdd5e526098 is going to be updated. [ 769.262413] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.262681] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.262681] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.263604] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.263604] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.263604] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b813a173-8617-4cd4-a1db-dfdd5e526098" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.303927] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b88e0956-a799-4c5e-8e71-323151811fd1 in Status: SUCCESS [ 769.304330] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.304641] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.304908] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.305309] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.305462] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.305520] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.305731] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.305876] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.305953] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.306102] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b88e0956-a799-4c5e-8e71-323151811fd1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.407622] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f706a4bc-cb3d-42f0-9e3b-9871aac4d673 in Status: SUCCESS [ 769.407862] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f706a4bc-cb3d-42f0-9e3b-9871aac4d673 deletion is rescheduled due to dependency. [ 769.407988] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f706a4bc-cb3d-42f0-9e3b-9871aac4d673" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.808354] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b88e0956-a799-4c5e-8e71-323151811fd1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.310683] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b88e0956-a799-4c5e-8e71-323151811fd1: rpc.has_security_group_logging(os_id): False [ 770.331986] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.332326] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.332326] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.332654] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.332824] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.333243] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.333413] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.333495] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.333780] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.333931] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.334097] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b88e0956-a799-4c5e-8e71-323151811fd1 is going to be updated. [ 770.403175] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.403428] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.403524] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.403810] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.404043] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.422439] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b88e0956-a799-4c5e-8e71-323151811fd1 in Status: IN_PROGRESS for 2s [ 770.528393] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e in Status: SUCCESS [ 770.532037] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.532037] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.532037] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.532037] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.532037] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.533158] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.533462] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.533566] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.533671] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.533898] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8fad12-41c9-413e-91de-8c1ff3cf914e taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.535646] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.535646] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.535646] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.535646] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.535646] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.535646] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.535646] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.535646] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.535646] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.535646] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3d8fad12-41c9-413e-91de-8c1ff3cf914e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.536643] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.537540] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.537729] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.537861] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.537928] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.539033] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.539033] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.539033] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d8fad12-41c9-413e-91de-8c1ff3cf914e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.040651] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d8fad12-41c9-413e-91de-8c1ff3cf914e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.043014] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3d8fad12-41c9-413e-91de-8c1ff3cf914e: rpc.has_security_group_logging(os_id): False [ 771.062778] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.062862] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.062940] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.063245] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.063383] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.063634] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.063775] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.063872] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.064068] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.064185] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.064410] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.064556] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.064626] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.064809] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.064912] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.065148] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.065248] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.065308] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.065453] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.065529] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.065629] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e is going to be created. [ 771.131636] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.131819] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.131868] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.132190] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.132275] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.148138] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e in Status: IN_PROGRESS for 2s [ 771.542799] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d8fad12-41c9-413e-91de-8c1ff3cf914e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.565672] env[65943]: INFO networking_nsxv3.common.synchronization [req-8c981769-888e-42f3-8f3c-f08d011ee0f1 req-e6115e1e-d4e2-417c-b876-1ab348d078ee tempest-ServerMetadataNegativeTestJSON-1273677523 tempest-ServerMetadataNegativeTestJSON-1273677523-project-member] Enqueued Resource ID: 68884628-4b38-403c-8fad-e29dfea783b0 with Priority: HIGHEST for action security_group_members [ 771.566214] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68884628-4b38-403c-8fad-e29dfea783b0 with Priority: HIGHEST for action security_group_members [ 771.566564] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-68884628-4b38-403c-8fad-e29dfea783b0 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.566690] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68884628-4b38-403c-8fad-e29dfea783b0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.566752] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68884628-4b38-403c-8fad-e29dfea783b0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.566962] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68884628-4b38-403c-8fad-e29dfea783b0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.567172] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.567291] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.567347] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.567595] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.567678] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.567772] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68884628-4b38-403c-8fad-e29dfea783b0',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.047993] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.048217] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.048302] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.048548] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.048648] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.048889] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e is going to be updated. [ 772.070941] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.071136] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.071246] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.071628] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.071628] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.071772] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.071875] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.072041] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.072304] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.072304] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.072397] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68884628-4b38-403c-8fad-e29dfea783b0 is going to be updated. [ 772.095581] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.095770] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.095822] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.096089] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.096258] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.109230] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e in Status: IN_PROGRESS for 2s [ 772.112520] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.113015] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.113015] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.113015] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.113142] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.121647] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68884628-4b38-403c-8fad-e29dfea783b0 in Status: IN_PROGRESS for 2s [ 772.384171] env[65943]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] NSXv3 Agent Agent loop - iteration:0 completed [ 772.384291] env[65943]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] NSXv3 Agent Agent loop - iteration:1 started [ 772.438182] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b88e0956-a799-4c5e-8e71-323151811fd1 in Status: SUCCESS [ 772.438841] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.166026] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e in Status: SUCCESS [ 773.166026] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.166026] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.166388] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.166388] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d8fad12-41c9-413e-91de-8c1ff3cf914e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.670811] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8fad12-41c9-413e-91de-8c1ff3cf914e taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.670957] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.121172] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e in Status: SUCCESS [ 774.121416] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.121569] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.121806] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.121996] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.122132] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.122198] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.122356] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.122464] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.122629] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d8fad12-41c9-413e-91de-8c1ff3cf914e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.132872] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68884628-4b38-403c-8fad-e29dfea783b0 in Status: SUCCESS [ 774.133129] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68884628-4b38-403c-8fad-e29dfea783b0 deletion is rescheduled due to dependency. [ 774.133186] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68884628-4b38-403c-8fad-e29dfea783b0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.625460] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d8fad12-41c9-413e-91de-8c1ff3cf914e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.923241] env[65943]: INFO networking_nsxv3.common.synchronization [req-d3a95247-67d2-40bc-8c5d-9c4e848cb60a req-e10a52b4-2bd4-49e8-aacc-7fd6dc676059 tempest-AttachInterfacesTestJSON-882476571 tempest-AttachInterfacesTestJSON-882476571-project-member] Enqueued Resource ID: 22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b with Priority: HIGHEST for action security_group_members [ 774.923775] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b with Priority: HIGHEST for action security_group_members [ 774.924111] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.924252] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.924320] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.924593] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.924767] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.924868] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.924932] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.925101] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.925186] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.925281] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.123822] env[65943]: INFO networking_nsxv3.common.synchronization [None req-18f1ff47-322d-4bc5-b454-a09e177debea None None] Enqueued Resource ID: 1a28d24b-6ab6-4155-a06a-45a42fb11f35 with Priority: HIGHEST for action port [ 775.124078] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a28d24b-6ab6-4155-a06a-45a42fb11f35 with Priority: HIGHEST for action port [ 775.124663] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a28d24b-6ab6-4155-a06a-45a42fb11f35 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.124815] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a28d24b-6ab6-4155-a06a-45a42fb11f35" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.124871] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a28d24b-6ab6-4155-a06a-45a42fb11f35" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.125836] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a28d24b-6ab6-4155-a06a-45a42fb11f35" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.125836] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a28d24b-6ab6-4155-a06a-45a42fb11f35',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.131902] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d8fad12-41c9-413e-91de-8c1ff3cf914e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.428177] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.429334] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.429334] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.429968] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.429968] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.429968] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.429968] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.430178] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.430275] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.430490] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.430490] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b already deleted. [ 775.430578] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.631478] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1a28d24b-6ab6-4155-a06a-45a42fb11f35 [ 775.632127] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.632321] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.632435] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.633307] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.633434] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.633538] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1a28d24b-6ab6-4155-a06a-45a42fb11f35 already deleted. [ 775.633626] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a28d24b-6ab6-4155-a06a-45a42fb11f35" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.633970] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.634100] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.634165] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.634335] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.634417] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.634503] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e is going to be updated. [ 775.649965] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-916 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.650146] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-916" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.650242] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-916" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.651572] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-916" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.651572] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.651572] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.651572] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.651938] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.652138] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.652406] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 775.652570] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 775.652710] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 775.653417] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 775.653417] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 775.653417] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 775.653627] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 775.668036] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.668192] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.668261] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.668462] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.668610] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.673526] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 775.673811] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 775.674015] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 775.674238] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-916" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.674583] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-4b300381-7606-4b18-8ab3-6d4a28507c8d taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.674801] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-4b300381-7606-4b18-8ab3-6d4a28507c8d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.674981] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-4b300381-7606-4b18-8ab3-6d4a28507c8d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.675322] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-4b300381-7606-4b18-8ab3-6d4a28507c8d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.675508] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b300381-7606-4b18-8ab3-6d4a28507c8d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.679053] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e in Status: IN_PROGRESS for 2s [ 776.178862] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.179255] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.179380] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.179806] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.180288] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.180288] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port 4b300381-7606-4b18-8ab3-6d4a28507c8d not found, creating... [ 776.180850] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.180850] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.180850] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.181119] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.181259] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.181603] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.182344] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.182344] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.182344] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.182344] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.182483] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: 4b300381-7606-4b18-8ab3-6d4a28507c8d is going to be created. [ 776.209014] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.209582] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.209582] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.209965] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.210011] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.210345] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-4b300381-7606-4b18-8ab3-6d4a28507c8d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.390437] env[65943]: INFO networking_nsxv3.common.synchronization [None req-3d714b5e-8298-48a9-9dab-5c37b2b79707 None None] Enqueued Resource ID: eab0c9bf-13ea-47ff-a3aa-82de2713e49e with Priority: HIGHEST for action port [ 776.391322] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eab0c9bf-13ea-47ff-a3aa-82de2713e49e with Priority: HIGHEST for action port [ 776.391727] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-eab0c9bf-13ea-47ff-a3aa-82de2713e49e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.391871] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eab0c9bf-13ea-47ff-a3aa-82de2713e49e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.391934] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eab0c9bf-13ea-47ff-a3aa-82de2713e49e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.392233] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eab0c9bf-13ea-47ff-a3aa-82de2713e49e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.392380] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eab0c9bf-13ea-47ff-a3aa-82de2713e49e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.898785] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eab0c9bf-13ea-47ff-a3aa-82de2713e49e [ 776.899124] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.899305] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.899390] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.899972] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.900163] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.900320] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eab0c9bf-13ea-47ff-a3aa-82de2713e49e already deleted. [ 776.900681] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eab0c9bf-13ea-47ff-a3aa-82de2713e49e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.990224] env[65943]: INFO networking_nsxv3.common.synchronization [req-d3a95247-67d2-40bc-8c5d-9c4e848cb60a req-b63739f3-f253-431a-b829-806517a97f88 service nova] Enqueued Resource ID: 22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b with Priority: HIGHEST for action security_group_rules [ 776.990387] env[65943]: INFO networking_nsxv3.common.synchronization [req-d3a95247-67d2-40bc-8c5d-9c4e848cb60a req-b63739f3-f253-431a-b829-806517a97f88 service nova] Enqueued Resource ID: 22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b with Priority: HIGHEST for action security_group_members [ 776.990511] env[65943]: INFO networking_nsxv3.common.synchronization [req-d3a95247-67d2-40bc-8c5d-9c4e848cb60a req-b63739f3-f253-431a-b829-806517a97f88 service nova] Enqueued Resource ID: 4b300381-7606-4b18-8ab3-6d4a28507c8d with Priority: HIGHEST for action port [ 776.990737] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b with Priority: HIGHEST for action security_group_rules [ 776.990862] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b with Priority: HIGHEST for action security_group_members [ 776.990957] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b300381-7606-4b18-8ab3-6d4a28507c8d with Priority: HIGHEST for action port [ 776.991557] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.991703] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.991759] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.994031] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.994031] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.994031] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.994031] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.994031] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.994031] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.994031] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.994031] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.994031] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.994031] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.994031] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.994031] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.995356] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b300381-7606-4b18-8ab3-6d4a28507c8d taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.995356] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b300381-7606-4b18-8ab3-6d4a28507c8d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.995356] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b300381-7606-4b18-8ab3-6d4a28507c8d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.995356] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b300381-7606-4b18-8ab3-6d4a28507c8d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.995356] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b300381-7606-4b18-8ab3-6d4a28507c8d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.205498] env[65943]: INFO networking_nsxv3.common.synchronization [req-6f93930e-561a-402b-b03f-9323fb107e29 req-ad1a7bee-407f-4697-9915-10030a143d8c tempest-AttachVolumeShelveTestJSON-1945734723 tempest-AttachVolumeShelveTestJSON-1945734723-project-member] Enqueued Resource ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 with Priority: HIGHEST for action security_group_members [ 777.209033] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 with Priority: HIGHEST for action security_group_members [ 777.209731] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7544afbe-03f8-421e-b9ed-b038f61ffc17 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.209909] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.209984] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.210314] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.210410] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.210546] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.210602] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.210706] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.210793] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.210882] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7544afbe-03f8-421e-b9ed-b038f61ffc17',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.497880] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.497880] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.497880] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4b300381-7606-4b18-8ab3-6d4a28507c8d with status ACTIVE [ 777.498159] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.498159] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.498159] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.498358] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.498566] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.498658] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.498709] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.498762] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.498943] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.499044] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.499210] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.499363] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.499363] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.499496] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.499591] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.499640] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4b300381-7606-4b18-8ab3-6d4a28507c8d is going to be updated. [ 777.500791] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.525611] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.525791] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.527966] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.527966] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.527966] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.527966] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b300381-7606-4b18-8ab3-6d4a28507c8d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.692740] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e in Status: SUCCESS [ 777.693481] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.693706] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.693972] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.694245] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.694439] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.694556] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.694806] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.697233] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.698087] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.698274] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3d8fad12-41c9-413e-91de-8c1ff3cf914e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.702167] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-695 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.702406] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-695" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.702471] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-695" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.702823] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-695" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.703110] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.703899] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.703899] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.704390] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.704637] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.704958] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 777.705261] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 777.705314] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 777.705459] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 777.705875] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 777.705988] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 777.706300] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 777.714580] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.714778] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.715160] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.715160] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.715287] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.715491] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.715642] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.715732] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.715962] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.716067] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.716171] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 already deleted. [ 777.716244] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.732025] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 777.732025] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 777.732025] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 777.732267] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-695" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.732485] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-a15b8ac0-bdf8-41cb-91e7-40e918f3d0bd taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.732591] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-a15b8ac0-bdf8-41cb-91e7-40e918f3d0bd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.733974] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-a15b8ac0-bdf8-41cb-91e7-40e918f3d0bd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.733974] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-a15b8ac0-bdf8-41cb-91e7-40e918f3d0bd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.733974] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a15b8ac0-bdf8-41cb-91e7-40e918f3d0bd',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.002689] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.113875] env[65943]: INFO networking_nsxv3.common.synchronization [None req-49b23ade-5843-4a19-a856-6be525803100 None None] Enqueued Resource ID: 567ca61c-3ffd-496f-9025-e5b584db34e7 with Priority: HIGHEST for action port [ 778.114442] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 567ca61c-3ffd-496f-9025-e5b584db34e7 with Priority: HIGHEST for action port [ 778.114745] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-567ca61c-3ffd-496f-9025-e5b584db34e7 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.114869] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-567ca61c-3ffd-496f-9025-e5b584db34e7" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.114936] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-567ca61c-3ffd-496f-9025-e5b584db34e7" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.118395] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-567ca61c-3ffd-496f-9025-e5b584db34e7" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.118681] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('567ca61c-3ffd-496f-9025-e5b584db34e7',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.201144] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8fad12-41c9-413e-91de-8c1ff3cf914e taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.201400] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.201493] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.201796] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.202025] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.202358] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.202456] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.202653] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.202774] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.202900] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.203118] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8fad12-41c9-413e-91de-8c1ff3cf914e taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.203463] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.203528] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.203716] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.203912] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.204395] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.205373] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.205612] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.205909] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.206187] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.206340] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3d8fad12-41c9-413e-91de-8c1ff3cf914e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.236400] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.236855] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.237060] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.237403] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.237668] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.237903] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port a15b8ac0-bdf8-41cb-91e7-40e918f3d0bd not found, creating... [ 778.238208] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.238445] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.238605] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.238875] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.239067] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.239402] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.239616] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.239836] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.240091] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.240285] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.240459] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: a15b8ac0-bdf8-41cb-91e7-40e918f3d0bd is going to be created. [ 778.262839] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.263198] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.263313] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.263566] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.263900] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.264159] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-a15b8ac0-bdf8-41cb-91e7-40e918f3d0bd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.505828] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.506896] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.506896] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.506896] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.506896] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.506896] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b is going to be created. [ 778.533534] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.533619] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.533689] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.533904] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.534085] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.545777] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b in Status: UNINITIALIZED for 2s [ 778.621126] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 567ca61c-3ffd-496f-9025-e5b584db34e7 [ 778.621392] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.621507] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.621577] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.621807] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.621922] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.622060] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:567ca61c-3ffd-496f-9025-e5b584db34e7 already deleted. [ 778.622202] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-567ca61c-3ffd-496f-9025-e5b584db34e7" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.709363] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3d8fad12-41c9-413e-91de-8c1ff3cf914e: rpc.has_security_group_logging(os_id): False [ 778.729542] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.730050] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.730050] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.730050] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.730267] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.730450] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.730573] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.730639] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.730939] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.730939] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.731227] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.731227] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.731330] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.731414] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.731494] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.731702] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.731854] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.731899] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.732281] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.732441] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.732441] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e is going to be updated. [ 778.793761] env[65943]: INFO networking_nsxv3.common.synchronization [None req-c17d28cd-b6dd-4f13-89de-1603b0d52b2e None None] Enqueued Resource ID: ff3bcf50-b05f-4dc3-9796-d9cd8d5bd20a with Priority: HIGHEST for action port [ 778.794728] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff3bcf50-b05f-4dc3-9796-d9cd8d5bd20a with Priority: HIGHEST for action port [ 778.795104] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff3bcf50-b05f-4dc3-9796-d9cd8d5bd20a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.795251] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff3bcf50-b05f-4dc3-9796-d9cd8d5bd20a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.795399] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff3bcf50-b05f-4dc3-9796-d9cd8d5bd20a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.795524] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff3bcf50-b05f-4dc3-9796-d9cd8d5bd20a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.795602] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff3bcf50-b05f-4dc3-9796-d9cd8d5bd20a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.817199] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.817429] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.817429] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.817751] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.817856] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.833285] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e in Status: IN_PROGRESS for 2s [ 779.050909] env[65943]: INFO networking_nsxv3.common.synchronization [req-6f93930e-561a-402b-b03f-9323fb107e29 req-0cd36eb4-368b-44ad-8337-7892e85c44b8 service nova] Enqueued Resource ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 with Priority: HIGHEST for action security_group_rules [ 779.051241] env[65943]: INFO networking_nsxv3.common.synchronization [req-6f93930e-561a-402b-b03f-9323fb107e29 req-0cd36eb4-368b-44ad-8337-7892e85c44b8 service nova] Enqueued Resource ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 with Priority: HIGHEST for action security_group_members [ 779.051463] env[65943]: INFO networking_nsxv3.common.synchronization [req-6f93930e-561a-402b-b03f-9323fb107e29 req-0cd36eb4-368b-44ad-8337-7892e85c44b8 service nova] Enqueued Resource ID: a15b8ac0-bdf8-41cb-91e7-40e918f3d0bd with Priority: HIGHEST for action port [ 779.054205] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 with Priority: HIGHEST for action security_group_rules [ 779.054457] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 with Priority: HIGHEST for action security_group_members [ 779.055068] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a15b8ac0-bdf8-41cb-91e7-40e918f3d0bd with Priority: HIGHEST for action port [ 779.055372] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7544afbe-03f8-421e-b9ed-b038f61ffc17 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.055896] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.055896] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.055896] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.055896] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7544afbe-03f8-421e-b9ed-b038f61ffc17',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.056866] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7544afbe-03f8-421e-b9ed-b038f61ffc17 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.057043] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.057092] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.057246] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.057476] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.057596] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.057850] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.059712] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.059840] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.059951] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7544afbe-03f8-421e-b9ed-b038f61ffc17',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.061243] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-a15b8ac0-bdf8-41cb-91e7-40e918f3d0bd taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.061371] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a15b8ac0-bdf8-41cb-91e7-40e918f3d0bd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.061936] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a15b8ac0-bdf8-41cb-91e7-40e918f3d0bd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.061936] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a15b8ac0-bdf8-41cb-91e7-40e918f3d0bd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.061936] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a15b8ac0-bdf8-41cb-91e7-40e918f3d0bd',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.298244] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ff3bcf50-b05f-4dc3-9796-d9cd8d5bd20a [ 779.298389] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.298532] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.298920] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.298920] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.298920] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.299066] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ff3bcf50-b05f-4dc3-9796-d9cd8d5bd20a already deleted. [ 779.299215] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff3bcf50-b05f-4dc3-9796-d9cd8d5bd20a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.565759] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7544afbe-03f8-421e-b9ed-b038f61ffc17 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.565889] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.566095] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7544afbe-03f8-421e-b9ed-b038f61ffc17',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.567062] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a15b8ac0-bdf8-41cb-91e7-40e918f3d0bd with status ACTIVE [ 779.568037] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.568037] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.568037] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.568037] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.568037] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.568037] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.568306] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.568306] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.568378] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.568465] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.568690] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.568896] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.568896] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.570737] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.570898] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.571036] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a15b8ac0-bdf8-41cb-91e7-40e918f3d0bd is going to be updated. [ 779.593650] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.593879] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.593879] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.594080] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.594216] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.594375] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a15b8ac0-bdf8-41cb-91e7-40e918f3d0bd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.671663] env[65943]: INFO networking_nsxv3.common.synchronization [req-aa9a53c8-18ce-4682-a962-d0f0025a0df5 req-72304065-e22a-44ac-87bf-e2aa8ff591f2 tempest-ImagesNegativeTestJSON-1570792871 tempest-ImagesNegativeTestJSON-1570792871-project-member] Enqueued Resource ID: 2f52b55d-af42-4f78-8a03-21345e5ab75d with Priority: HIGHEST for action security_group_members [ 779.672564] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f52b55d-af42-4f78-8a03-21345e5ab75d with Priority: HIGHEST for action security_group_members [ 779.672564] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f52b55d-af42-4f78-8a03-21345e5ab75d taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.672715] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f52b55d-af42-4f78-8a03-21345e5ab75d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.672715] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f52b55d-af42-4f78-8a03-21345e5ab75d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.674330] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f52b55d-af42-4f78-8a03-21345e5ab75d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.674544] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.674693] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.674765] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.674961] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.675076] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.675168] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f52b55d-af42-4f78-8a03-21345e5ab75d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.046875] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-558 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.047116] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-558" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.047341] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-558" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.047671] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-558" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.047918] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.048100] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.048216] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.048422] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.048559] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.048766] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 780.048873] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 780.048973] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 780.049085] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 780.049187] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 780.049283] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 780.049411] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 780.070650] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 780.070912] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 780.071043] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 780.071203] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-558" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.071540] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-97012a4e-8bd9-437b-881f-36f4a6eda969 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.071729] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-97012a4e-8bd9-437b-881f-36f4a6eda969" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.071853] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-97012a4e-8bd9-437b-881f-36f4a6eda969" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.072213] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-97012a4e-8bd9-437b-881f-36f4a6eda969" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.072377] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97012a4e-8bd9-437b-881f-36f4a6eda969',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.073346] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7544afbe-03f8-421e-b9ed-b038f61ffc17',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.178417] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.178573] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.178659] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.178948] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.179400] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.179400] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.179584] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.179584] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.179679] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.179756] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.179854] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f52b55d-af42-4f78-8a03-21345e5ab75d already deleted. [ 780.179932] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f52b55d-af42-4f78-8a03-21345e5ab75d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.557919] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b in Status: SUCCESS [ 780.557919] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.557919] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.557919] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.557919] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.557919] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.557919] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.557919] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.557919] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.557919] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.557919] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.578271] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.578755] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.579024] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.579585] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.579819] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.580042] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port 97012a4e-8bd9-437b-881f-36f4a6eda969 not found, creating... [ 780.580524] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.580800] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.581069] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.581962] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.581962] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.581962] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.582193] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.582372] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.582637] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.582740] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.582943] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: 97012a4e-8bd9-437b-881f-36f4a6eda969 is going to be created. [ 780.584507] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.584507] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.584507] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.584624] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.584862] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.585027] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 is going to be created. [ 780.610545] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.610853] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.611029] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.611376] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.611644] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.611912] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-97012a4e-8bd9-437b-881f-36f4a6eda969" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.618124] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.618371] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.618498] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.618819] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.619089] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.629348] env[65943]: INFO networking_nsxv3.common.synchronization [None req-b9858eac-90a7-45b5-bd47-9b4759963a86 None None] Enqueued Resource ID: be856c5c-3409-49a0-b35f-89d0df00df73 with Priority: HIGHEST for action port [ 780.630207] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be856c5c-3409-49a0-b35f-89d0df00df73 with Priority: HIGHEST for action port [ 780.630749] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-be856c5c-3409-49a0-b35f-89d0df00df73 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.631056] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be856c5c-3409-49a0-b35f-89d0df00df73" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.631250] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be856c5c-3409-49a0-b35f-89d0df00df73" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.631629] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be856c5c-3409-49a0-b35f-89d0df00df73" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.632492] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be856c5c-3409-49a0-b35f-89d0df00df73',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.634171] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 in Status: UNINITIALIZED for 2s [ 780.847485] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e in Status: SUCCESS [ 780.847733] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.847921] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.849633] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.849633] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d8fad12-41c9-413e-91de-8c1ff3cf914e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.060892] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.135218] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port be856c5c-3409-49a0-b35f-89d0df00df73 [ 781.135667] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.135732] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.135966] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.139201] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.139346] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.139469] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:be856c5c-3409-49a0-b35f-89d0df00df73 already deleted. [ 781.139558] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be856c5c-3409-49a0-b35f-89d0df00df73" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.352555] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8fad12-41c9-413e-91de-8c1ff3cf914e taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.352555] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.352681] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.352856] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.358028] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.358028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.358028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.358028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.358028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.358028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.358028] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3d8fad12-41c9-413e-91de-8c1ff3cf914e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.481214] env[65943]: INFO networking_nsxv3.common.synchronization [req-aa9a53c8-18ce-4682-a962-d0f0025a0df5 req-8e78cbae-e125-4dc5-bcd3-a99b657e91de service nova] Enqueued Resource ID: 2f52b55d-af42-4f78-8a03-21345e5ab75d with Priority: HIGHEST for action security_group_rules [ 781.481214] env[65943]: INFO networking_nsxv3.common.synchronization [req-aa9a53c8-18ce-4682-a962-d0f0025a0df5 req-8e78cbae-e125-4dc5-bcd3-a99b657e91de service nova] Enqueued Resource ID: 2f52b55d-af42-4f78-8a03-21345e5ab75d with Priority: HIGHEST for action security_group_members [ 781.481214] env[65943]: INFO networking_nsxv3.common.synchronization [req-aa9a53c8-18ce-4682-a962-d0f0025a0df5 req-8e78cbae-e125-4dc5-bcd3-a99b657e91de service nova] Enqueued Resource ID: 97012a4e-8bd9-437b-881f-36f4a6eda969 with Priority: HIGHEST for action port [ 781.481649] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f52b55d-af42-4f78-8a03-21345e5ab75d with Priority: HIGHEST for action security_group_rules [ 781.482664] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f52b55d-af42-4f78-8a03-21345e5ab75d with Priority: HIGHEST for action security_group_members [ 781.482664] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97012a4e-8bd9-437b-881f-36f4a6eda969 with Priority: HIGHEST for action port [ 781.482846] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f52b55d-af42-4f78-8a03-21345e5ab75d taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.482846] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f52b55d-af42-4f78-8a03-21345e5ab75d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.483028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f52b55d-af42-4f78-8a03-21345e5ab75d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.483262] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f52b55d-af42-4f78-8a03-21345e5ab75d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.483323] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f52b55d-af42-4f78-8a03-21345e5ab75d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.488043] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f52b55d-af42-4f78-8a03-21345e5ab75d taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.488170] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f52b55d-af42-4f78-8a03-21345e5ab75d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.491024] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f52b55d-af42-4f78-8a03-21345e5ab75d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.491024] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f52b55d-af42-4f78-8a03-21345e5ab75d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.491024] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.491024] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.491024] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.491024] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.491024] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.491024] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f52b55d-af42-4f78-8a03-21345e5ab75d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.491024] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-97012a4e-8bd9-437b-881f-36f4a6eda969 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.491024] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97012a4e-8bd9-437b-881f-36f4a6eda969" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.491024] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97012a4e-8bd9-437b-881f-36f4a6eda969" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.491024] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97012a4e-8bd9-437b-881f-36f4a6eda969" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.491024] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97012a4e-8bd9-437b-881f-36f4a6eda969',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.564296] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b: rpc.has_security_group_logging(os_id): False [ 781.586084] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.586084] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.586084] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.586084] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.586084] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.586616] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.586616] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.586616] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.586616] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.586616] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.586616] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b is going to be created. [ 781.664316] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.664316] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.664316] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.664316] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.664316] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.675553] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b in Status: IN_PROGRESS for 2s [ 781.860571] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8fad12-41c9-413e-91de-8c1ff3cf914e taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.860765] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.860808] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.863026] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.863026] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.863026] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.863026] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.863026] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.863026] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.863026] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.863026] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8fad12-41c9-413e-91de-8c1ff3cf914e taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.863026] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.863026] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.863026] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.863026] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.863026] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.863026] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.863026] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.863026] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.863026] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.863026] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3d8fad12-41c9-413e-91de-8c1ff3cf914e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.996564] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f52b55d-af42-4f78-8a03-21345e5ab75d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.996564] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f52b55d-af42-4f78-8a03-21345e5ab75d taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.996564] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f52b55d-af42-4f78-8a03-21345e5ab75d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.997433] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 97012a4e-8bd9-437b-881f-36f4a6eda969 with status ACTIVE [ 781.997872] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.997872] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.997872] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.998114] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.998214] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.998400] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.998505] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.998569] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.998860] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.998860] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.998999] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.999112] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.999175] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.999323] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.999403] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.999504] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 97012a4e-8bd9-437b-881f-36f4a6eda969 is going to be updated. [ 782.024848] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.024848] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.024848] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.025146] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.025146] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.025298] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97012a4e-8bd9-437b-881f-36f4a6eda969" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.366089] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3d8fad12-41c9-413e-91de-8c1ff3cf914e: rpc.has_security_group_logging(os_id): False [ 782.385483] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.385628] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.385757] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.385917] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.386017] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.387038] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.387038] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.387038] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.387038] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.387038] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.387038] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.387038] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.387038] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.387418] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.387418] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.387418] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.387523] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.387523] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.387657] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.387750] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.387831] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e is going to be updated. [ 782.462808] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.462808] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.462808] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.463079] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.463079] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.486198] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e in Status: IN_PROGRESS for 2s [ 782.502676] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f52b55d-af42-4f78-8a03-21345e5ab75d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.647915] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 in Status: UNINITIALIZED for 4s [ 783.007273] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.007468] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.007576] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.011389] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.011389] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.011389] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f52b55d-af42-4f78-8a03-21345e5ab75d is going to be created. [ 783.038854] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.038854] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.039099] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.039477] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.039477] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.053936] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f52b55d-af42-4f78-8a03-21345e5ab75d in Status: UNINITIALIZED for 2s [ 783.153308] env[65943]: INFO networking_nsxv3.common.synchronization [None req-0493271a-2bc7-4bf7-858c-c12e1a4ae7d8 None None] Enqueued Resource ID: 58716583-3d81-492e-a867-2828e2584b08 with Priority: HIGHEST for action port [ 783.153308] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58716583-3d81-492e-a867-2828e2584b08 with Priority: HIGHEST for action port [ 783.155584] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-58716583-3d81-492e-a867-2828e2584b08 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.155584] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58716583-3d81-492e-a867-2828e2584b08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.155584] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58716583-3d81-492e-a867-2828e2584b08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.155584] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58716583-3d81-492e-a867-2828e2584b08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.155584] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58716583-3d81-492e-a867-2828e2584b08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.659651] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 58716583-3d81-492e-a867-2828e2584b08 [ 783.659986] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.660164] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.660243] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.660454] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.660543] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.660636] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:58716583-3d81-492e-a867-2828e2584b08 already deleted. [ 783.660716] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58716583-3d81-492e-a867-2828e2584b08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.691912] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b in Status: SUCCESS [ 783.692156] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.500865] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e in Status: SUCCESS [ 784.500865] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.659535] env[65943]: INFO networking_nsxv3.common.synchronization [req-0264d5c2-4755-4193-8e05-eb27036054ba req-961a69c7-fce4-477e-8d4b-827afc4487c0 tempest-ServersNegativeTestJSON-1424653399 tempest-ServersNegativeTestJSON-1424653399-project-member] Enqueued Resource ID: 55c4b60d-641f-4044-8228-251f73d38ecb with Priority: HIGHEST for action security_group_members [ 784.660631] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 in Status: SUCCESS [ 784.660924] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.661858] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55c4b60d-641f-4044-8228-251f73d38ecb with Priority: HIGHEST for action security_group_members [ 784.661858] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.662009] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.662128] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.662253] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.662339] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.662583] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.662760] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.662976] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.663121] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7544afbe-03f8-421e-b9ed-b038f61ffc17',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.664624] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-55c4b60d-641f-4044-8228-251f73d38ecb taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.664624] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.664624] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.665056] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.665748] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.665748] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.665748] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.665997] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.666266] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.666461] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55c4b60d-641f-4044-8228-251f73d38ecb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.067291] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f52b55d-af42-4f78-8a03-21345e5ab75d in Status: SUCCESS [ 785.067578] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f52b55d-af42-4f78-8a03-21345e5ab75d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.067881] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f52b55d-af42-4f78-8a03-21345e5ab75d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.068125] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f52b55d-af42-4f78-8a03-21345e5ab75d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.068355] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.068558] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.068707] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.068902] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.069050] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.069185] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f52b55d-af42-4f78-8a03-21345e5ab75d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.069319] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f52b55d-af42-4f78-8a03-21345e5ab75d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.126218] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-737 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.126727] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-737" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.126727] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-737" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.126956] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-737" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.127217] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.127369] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.127473] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.127713] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.127823] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.128056] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 785.128193] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 785.128259] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 785.128348] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 785.128458] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 785.128565] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 785.128674] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 785.153092] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 785.153372] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 785.153551] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 785.153789] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-737" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.154168] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-cd260d43-f640-4b97-b41f-14617a24b1a9 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.154377] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-cd260d43-f640-4b97-b41f-14617a24b1a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.154534] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-cd260d43-f640-4b97-b41f-14617a24b1a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.155130] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-cd260d43-f640-4b97-b41f-14617a24b1a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.155203] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd260d43-f640-4b97-b41f-14617a24b1a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.168911] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7544afbe-03f8-421e-b9ed-b038f61ffc17',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.171391] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.173027] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.173027] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.173027] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.173184] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.173861] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.174049] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.174119] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.174346] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.174882] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.175091] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55c4b60d-641f-4044-8228-251f73d38ecb already deleted. [ 785.175217] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.574251] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f52b55d-af42-4f78-8a03-21345e5ab75d taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.574251] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f52b55d-af42-4f78-8a03-21345e5ab75d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.574251] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f52b55d-af42-4f78-8a03-21345e5ab75d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.574251] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f52b55d-af42-4f78-8a03-21345e5ab75d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.574251] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.574251] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.574251] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.574251] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.574251] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.574251] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f52b55d-af42-4f78-8a03-21345e5ab75d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.574251] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f52b55d-af42-4f78-8a03-21345e5ab75d taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.574251] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f52b55d-af42-4f78-8a03-21345e5ab75d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.574251] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f52b55d-af42-4f78-8a03-21345e5ab75d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.574251] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f52b55d-af42-4f78-8a03-21345e5ab75d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.574251] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.574251] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.575340] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.575340] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.575340] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.575340] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f52b55d-af42-4f78-8a03-21345e5ab75d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.575340] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f52b55d-af42-4f78-8a03-21345e5ab75d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.659670] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.659670] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.659670] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.659670] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.659973] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.659973] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port cd260d43-f640-4b97-b41f-14617a24b1a9 not found, creating... [ 785.660204] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.660392] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.660537] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.660691] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.660915] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.661499] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.661499] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.661499] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.661680] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.661680] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.661792] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: cd260d43-f640-4b97-b41f-14617a24b1a9 is going to be created. [ 785.674268] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7544afbe-03f8-421e-b9ed-b038f61ffc17: rpc.has_security_group_logging(os_id): False [ 785.687527] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.688875] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.688875] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.688875] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.688875] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.688875] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-cd260d43-f640-4b97-b41f-14617a24b1a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.692677] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.692816] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.692886] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.693112] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.693213] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.693462] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.693575] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.693701] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.693878] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.693958] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.694193] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 is going to be created. [ 785.791186] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.791349] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.791472] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.791607] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.791789] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.817582] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 in Status: IN_PROGRESS for 2s [ 786.079662] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f52b55d-af42-4f78-8a03-21345e5ab75d: rpc.has_security_group_logging(os_id): False [ 786.102039] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.102208] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.102273] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.102576] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.102758] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.102880] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.102982] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.103058] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.103219] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.103299] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.103495] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.103591] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.103666] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.103909] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.103988] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.104206] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.104302] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.104359] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.104549] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.104639] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.104749] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f52b55d-af42-4f78-8a03-21345e5ab75d is going to be created. [ 786.194769] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.194926] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.195016] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.195237] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.195613] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.213017] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f52b55d-af42-4f78-8a03-21345e5ab75d in Status: IN_PROGRESS for 2s [ 786.522366] env[65943]: INFO networking_nsxv3.common.synchronization [req-0264d5c2-4755-4193-8e05-eb27036054ba req-c1285b05-49ed-4774-913c-470f342bfdec service nova] Enqueued Resource ID: 55c4b60d-641f-4044-8228-251f73d38ecb with Priority: HIGHEST for action security_group_rules [ 786.522631] env[65943]: INFO networking_nsxv3.common.synchronization [req-0264d5c2-4755-4193-8e05-eb27036054ba req-c1285b05-49ed-4774-913c-470f342bfdec service nova] Enqueued Resource ID: 55c4b60d-641f-4044-8228-251f73d38ecb with Priority: HIGHEST for action security_group_members [ 786.522759] env[65943]: INFO networking_nsxv3.common.synchronization [req-0264d5c2-4755-4193-8e05-eb27036054ba req-c1285b05-49ed-4774-913c-470f342bfdec service nova] Enqueued Resource ID: cd260d43-f640-4b97-b41f-14617a24b1a9 with Priority: HIGHEST for action port [ 786.523868] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55c4b60d-641f-4044-8228-251f73d38ecb with Priority: HIGHEST for action security_group_rules [ 786.524070] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55c4b60d-641f-4044-8228-251f73d38ecb with Priority: HIGHEST for action security_group_members [ 786.524212] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd260d43-f640-4b97-b41f-14617a24b1a9 with Priority: HIGHEST for action port [ 786.524566] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55c4b60d-641f-4044-8228-251f73d38ecb taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.524697] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.524776] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.525151] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.525525] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55c4b60d-641f-4044-8228-251f73d38ecb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.528076] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-55c4b60d-641f-4044-8228-251f73d38ecb taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.528076] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.528076] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.528076] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.528076] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.528076] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.528419] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.528419] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.528419] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.528556] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55c4b60d-641f-4044-8228-251f73d38ecb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.529339] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd260d43-f640-4b97-b41f-14617a24b1a9 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.529456] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd260d43-f640-4b97-b41f-14617a24b1a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.529513] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd260d43-f640-4b97-b41f-14617a24b1a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.529655] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd260d43-f640-4b97-b41f-14617a24b1a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.529753] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd260d43-f640-4b97-b41f-14617a24b1a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.032836] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55c4b60d-641f-4044-8228-251f73d38ecb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.033888] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-55c4b60d-641f-4044-8228-251f73d38ecb taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.034530] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.034530] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cd260d43-f640-4b97-b41f-14617a24b1a9 with status ACTIVE [ 787.034530] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.034693] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.035052] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.035052] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.035203] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.035458] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.035678] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.035797] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.035984] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.036078] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.036279] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.036406] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.036494] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.036744] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.036830] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.036965] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cd260d43-f640-4b97-b41f-14617a24b1a9 is going to be updated. [ 787.060731] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.060973] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.061072] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.061283] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.061420] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.061582] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd260d43-f640-4b97-b41f-14617a24b1a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.144375] env[65943]: INFO networking_nsxv3.common.synchronization [req-96b77603-1917-4f41-9942-620b0850d068 req-f3624d59-407f-4776-9292-304a6a6a3d63 tempest-ServersAdminTestJSON-910281195 tempest-ServersAdminTestJSON-910281195-project-member] Enqueued Resource ID: e02be8c7-70b1-4488-b079-b1ebf20a733c with Priority: HIGHEST for action security_group_members [ 787.144520] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e02be8c7-70b1-4488-b079-b1ebf20a733c with Priority: HIGHEST for action security_group_members [ 787.144833] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e02be8c7-70b1-4488-b079-b1ebf20a733c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.144965] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.145032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.145220] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.145366] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.145457] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.145513] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.145681] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.145858] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.145919] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.539558] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55c4b60d-641f-4044-8228-251f73d38ecb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.648425] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.834743] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 in Status: SUCCESS [ 787.834743] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.042348] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.042680] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.042680] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.042937] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.043388] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.043388] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55c4b60d-641f-4044-8228-251f73d38ecb is going to be created. [ 788.069622] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.069893] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.069960] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.070146] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.070387] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.082193] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55c4b60d-641f-4044-8228-251f73d38ecb in Status: UNINITIALIZED for 2s [ 788.153717] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.228044] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f52b55d-af42-4f78-8a03-21345e5ab75d in Status: SUCCESS [ 788.228044] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f52b55d-af42-4f78-8a03-21345e5ab75d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.399588] env[65943]: INFO networking_nsxv3.common.synchronization [None req-f7dfb21b-4e31-4ea1-9199-51d4cff61645 None None] Enqueued Resource ID: cf9dcf16-9c92-40df-87c3-744869587d44 with Priority: HIGHEST for action port [ 788.399588] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf9dcf16-9c92-40df-87c3-744869587d44 with Priority: HIGHEST for action port [ 788.403810] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf9dcf16-9c92-40df-87c3-744869587d44 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.404060] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf9dcf16-9c92-40df-87c3-744869587d44" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.404142] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf9dcf16-9c92-40df-87c3-744869587d44" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.404785] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf9dcf16-9c92-40df-87c3-744869587d44" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.404938] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf9dcf16-9c92-40df-87c3-744869587d44',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.497095] env[65943]: INFO networking_nsxv3.common.synchronization [None req-43a5c544-f002-46bf-8180-23946fe65bcf tempest-ServerActionsTestJSON-1587559204 tempest-ServerActionsTestJSON-1587559204-project-member] Enqueued Resource ID: 120a53f4-6f9e-423c-b6c7-c18e7f4310a8 with Priority: HIGHEST for action security_group_rules [ 788.499282] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 120a53f4-6f9e-423c-b6c7-c18e7f4310a8 with Priority: HIGHEST for action security_group_rules [ 788.500677] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-120a53f4-6f9e-423c-b6c7-c18e7f4310a8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.501841] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-120a53f4-6f9e-423c-b6c7-c18e7f4310a8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.502140] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-120a53f4-6f9e-423c-b6c7-c18e7f4310a8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.502596] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-120a53f4-6f9e-423c-b6c7-c18e7f4310a8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.504024] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('120a53f4-6f9e-423c-b6c7-c18e7f4310a8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.656147] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.656307] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.656380] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.656601] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.656733] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.657786] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e02be8c7-70b1-4488-b079-b1ebf20a733c is going to be updated. [ 788.686311] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.686502] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.686917] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.686917] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.687096] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.697514] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e02be8c7-70b1-4488-b079-b1ebf20a733c in Status: IN_PROGRESS for 2s [ 788.787215] env[65943]: INFO networking_nsxv3.common.synchronization [None req-ea020165-f5b3-4581-837c-4c00b7c75795 tempest-ServerActionsTestJSON-1587559204 tempest-ServerActionsTestJSON-1587559204-project-member] Enqueued Resource ID: 120a53f4-6f9e-423c-b6c7-c18e7f4310a8 with Priority: HIGHEST for action security_group_rules [ 788.787856] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 120a53f4-6f9e-423c-b6c7-c18e7f4310a8 with Priority: HIGHEST for action security_group_rules [ 788.788205] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-120a53f4-6f9e-423c-b6c7-c18e7f4310a8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.788360] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-120a53f4-6f9e-423c-b6c7-c18e7f4310a8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.907918] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cf9dcf16-9c92-40df-87c3-744869587d44 [ 788.908312] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.908509] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.908678] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.908869] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.909176] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.909326] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cf9dcf16-9c92-40df-87c3-744869587d44 already deleted. [ 788.909452] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf9dcf16-9c92-40df-87c3-744869587d44" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.036381] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.036589] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.036674] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.037545] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.037545] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.037545] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 120a53f4-6f9e-423c-b6c7-c18e7f4310a8 already deleted. [ 789.037545] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-120a53f4-6f9e-423c-b6c7-c18e7f4310a8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.037545] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-120a53f4-6f9e-423c-b6c7-c18e7f4310a8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.037545] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-120a53f4-6f9e-423c-b6c7-c18e7f4310a8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.037887] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('120a53f4-6f9e-423c-b6c7-c18e7f4310a8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.565285] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.565658] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.565658] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.565844] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.565967] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.566095] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 120a53f4-6f9e-423c-b6c7-c18e7f4310a8 already deleted. [ 789.566199] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-120a53f4-6f9e-423c-b6c7-c18e7f4310a8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.887305] env[65943]: INFO networking_nsxv3.common.synchronization [req-280fe8ac-87d9-418d-bb56-093ba684569e req-d2d66d2d-c113-4841-8634-5cfbb4ad250a tempest-ListServersNegativeTestJSON-1591552957 tempest-ListServersNegativeTestJSON-1591552957-project-member] Enqueued Resource ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf with Priority: HIGHEST for action security_group_members [ 789.887926] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf with Priority: HIGHEST for action security_group_members [ 789.888293] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.888428] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.888499] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.888789] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.888951] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.889095] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.889180] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.889375] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.889576] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.889576] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cddfb2d8-8ac5-496b-aee4-ea09e6b59edf',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.093427] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55c4b60d-641f-4044-8228-251f73d38ecb in Status: SUCCESS [ 790.096023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.096023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.096023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.096023] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.096023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.096023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.096023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.096023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.096023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.096023] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55c4b60d-641f-4044-8228-251f73d38ecb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.306041] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-496 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.306512] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-496" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.306512] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-496" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.306834] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-496" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.310454] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.311309] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.311456] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.311747] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.312035] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.312148] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 790.312257] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 790.312383] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 790.312502] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 790.312635] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 790.312774] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 790.312947] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 790.337669] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 790.337669] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 790.337669] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 790.338124] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-496" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.338298] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-5379375f-d4bc-4374-99c1-82eac7b986eb taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.338566] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-5379375f-d4bc-4374-99c1-82eac7b986eb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.338566] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-5379375f-d4bc-4374-99c1-82eac7b986eb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.339264] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-5379375f-d4bc-4374-99c1-82eac7b986eb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.339264] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5379375f-d4bc-4374-99c1-82eac7b986eb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.393974] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.394259] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.394343] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.394579] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.394623] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.394832] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.394956] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.395020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.395141] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.395216] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.395479] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf already deleted. [ 790.395479] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.599046] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-55c4b60d-641f-4044-8228-251f73d38ecb taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.599392] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.599392] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.599542] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.599696] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.599794] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.599856] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.600011] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.600106] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.600195] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.600346] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-55c4b60d-641f-4044-8228-251f73d38ecb taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.600437] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.600499] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.600638] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.600774] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.600862] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.600921] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.601069] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.601148] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.601227] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.601316] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55c4b60d-641f-4044-8228-251f73d38ecb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.709742] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e02be8c7-70b1-4488-b079-b1ebf20a733c in Status: SUCCESS [ 790.710324] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.787020] env[65943]: INFO networking_nsxv3.common.synchronization [None req-af8e8a61-5a51-4c8c-9a8d-270b9be6b394 None None] Enqueued Resource ID: 63289f92-f645-403f-94af-69e55f223ab4 with Priority: HIGHEST for action port [ 790.787020] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63289f92-f645-403f-94af-69e55f223ab4 with Priority: HIGHEST for action port [ 790.787020] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-63289f92-f645-403f-94af-69e55f223ab4 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.787020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63289f92-f645-403f-94af-69e55f223ab4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.787020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63289f92-f645-403f-94af-69e55f223ab4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.787020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63289f92-f645-403f-94af-69e55f223ab4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.787020] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63289f92-f645-403f-94af-69e55f223ab4',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.841052] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.842211] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.842368] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.842640] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.843423] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.843648] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port 5379375f-d4bc-4374-99c1-82eac7b986eb not found, creating... [ 790.844435] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.844622] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.844762] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.845014] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.845161] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.845452] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.845606] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.845720] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.845920] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.846059] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.846190] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: 5379375f-d4bc-4374-99c1-82eac7b986eb is going to be created. [ 790.870501] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.870804] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.870991] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.871507] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.871686] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.872020] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-5379375f-d4bc-4374-99c1-82eac7b986eb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.888782] env[65943]: INFO networking_nsxv3.common.synchronization [None req-6e5e215c-8bba-476d-8449-7983b878d513 tempest-ServerActionsTestOtherB-2092325239 tempest-ServerActionsTestOtherB-2092325239-project-member] Enqueued Resource ID: 2880c629-d8d0-45b5-b939-d99c78caab70 with Priority: HIGHEST for action security_group_rules [ 790.889111] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2880c629-d8d0-45b5-b939-d99c78caab70 with Priority: HIGHEST for action security_group_rules [ 790.889237] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2880c629-d8d0-45b5-b939-d99c78caab70 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.892040] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.892040] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.892040] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.892040] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2880c629-d8d0-45b5-b939-d99c78caab70',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.105110] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55c4b60d-641f-4044-8228-251f73d38ecb: rpc.has_security_group_logging(os_id): False [ 791.124668] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.124668] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.124668] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.124923] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.124923] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.125140] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.125243] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.125305] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.125475] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.125558] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.125740] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.125861] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.125933] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.128227] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.128332] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.128544] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.128648] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.128730] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.128886] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.129182] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.129182] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55c4b60d-641f-4044-8228-251f73d38ecb is going to be created. [ 791.197024] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.197298] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.197391] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.197645] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.197884] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.214176] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55c4b60d-641f-4044-8228-251f73d38ecb in Status: IN_PROGRESS for 2s [ 791.291431] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 63289f92-f645-403f-94af-69e55f223ab4 [ 791.291682] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.291821] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.291891] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.292185] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.292272] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.292375] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:63289f92-f645-403f-94af-69e55f223ab4 already deleted. [ 791.292457] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63289f92-f645-403f-94af-69e55f223ab4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.417698] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.417698] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.417698] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.417698] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.418020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.418020] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2880c629-d8d0-45b5-b939-d99c78caab70 already deleted. [ 791.418020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.552641] env[65943]: INFO networking_nsxv3.common.synchronization [None req-453fd565-5e13-4dc1-bb4f-e5fa1182c981 tempest-ServerActionsTestOtherB-2092325239 tempest-ServerActionsTestOtherB-2092325239-project-member] Enqueued Resource ID: 2880c629-d8d0-45b5-b939-d99c78caab70 with Priority: HIGHEST for action security_group_rules [ 791.554185] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2880c629-d8d0-45b5-b939-d99c78caab70 with Priority: HIGHEST for action security_group_rules [ 791.554644] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2880c629-d8d0-45b5-b939-d99c78caab70 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.554864] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.554964] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.555222] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.555353] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2880c629-d8d0-45b5-b939-d99c78caab70',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.993239] env[65943]: INFO networking_nsxv3.common.synchronization [req-280fe8ac-87d9-418d-bb56-093ba684569e req-cc882ba2-4e2d-4f42-8cbd-1e7d5cee6f17 service nova] Enqueued Resource ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf with Priority: HIGHEST for action security_group_rules [ 791.993474] env[65943]: INFO networking_nsxv3.common.synchronization [req-280fe8ac-87d9-418d-bb56-093ba684569e req-cc882ba2-4e2d-4f42-8cbd-1e7d5cee6f17 service nova] Enqueued Resource ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf with Priority: HIGHEST for action security_group_members [ 791.993831] env[65943]: INFO networking_nsxv3.common.synchronization [req-280fe8ac-87d9-418d-bb56-093ba684569e req-cc882ba2-4e2d-4f42-8cbd-1e7d5cee6f17 service nova] Enqueued Resource ID: 5379375f-d4bc-4374-99c1-82eac7b986eb with Priority: HIGHEST for action port [ 791.998293] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf with Priority: HIGHEST for action security_group_rules [ 791.998496] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf with Priority: HIGHEST for action security_group_members [ 791.998652] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5379375f-d4bc-4374-99c1-82eac7b986eb with Priority: HIGHEST for action port [ 791.999355] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.999508] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.999582] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.999895] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.999990] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cddfb2d8-8ac5-496b-aee4-ea09e6b59edf',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.001405] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.001405] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.001405] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.001598] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.001676] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.001776] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.001866] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.002081] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.002172] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.002310] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cddfb2d8-8ac5-496b-aee4-ea09e6b59edf',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.003461] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-5379375f-d4bc-4374-99c1-82eac7b986eb taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.003594] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5379375f-d4bc-4374-99c1-82eac7b986eb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.003665] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5379375f-d4bc-4374-99c1-82eac7b986eb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.003838] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5379375f-d4bc-4374-99c1-82eac7b986eb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.003919] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5379375f-d4bc-4374-99c1-82eac7b986eb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.080019] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.080167] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.080226] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.080434] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.080526] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.080619] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2880c629-d8d0-45b5-b939-d99c78caab70 already deleted. [ 792.080699] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.508346] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.508500] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.508663] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cddfb2d8-8ac5-496b-aee4-ea09e6b59edf',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.509561] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5379375f-d4bc-4374-99c1-82eac7b986eb with status ACTIVE [ 792.509736] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.510035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.510035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.510155] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.510203] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.510350] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.510442] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.510500] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.510647] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.510735] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.510892] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.510977] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.511037] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.511175] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.511245] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.511325] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5379375f-d4bc-4374-99c1-82eac7b986eb is going to be updated. [ 792.533853] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.533955] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.533955] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.534173] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.534365] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.534464] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5379375f-d4bc-4374-99c1-82eac7b986eb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.013842] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cddfb2d8-8ac5-496b-aee4-ea09e6b59edf',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.229018] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55c4b60d-641f-4044-8228-251f73d38ecb in Status: SUCCESS [ 793.229297] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.518484] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.518711] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.518771] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.519623] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.519623] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.519623] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf is going to be created. [ 793.542317] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.542463] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.542534] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.542739] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.542889] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.551664] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf in Status: UNINITIALIZED for 2s [ 795.460500] env[65943]: INFO networking_nsxv3.common.synchronization [req-44e16df7-1f59-4f13-b3fe-9d9e88ef1173 req-0b00e7c3-5d59-46b6-aa6d-e2254d4507e6 tempest-ImagesTestJSON-196343566 tempest-ImagesTestJSON-196343566-project-member] Enqueued Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_members [ 795.461072] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_members [ 795.461725] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c81f5e-9888-4914-ab90-42d06116db49 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.461855] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.461932] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.462143] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.462305] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.462407] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.462481] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.462634] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.462739] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.462831] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.563292] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf in Status: SUCCESS [ 795.563518] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.563685] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.563899] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.564323] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.564453] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.564517] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.564706] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.564845] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.564945] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.565906] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cddfb2d8-8ac5-496b-aee4-ea09e6b59edf',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.717777] env[65943]: INFO networking_nsxv3.common.synchronization [req-67826745-3c2b-499c-badc-b6858f598094 req-028001b2-5e1e-47cc-aa67-998ac7c117f4 tempest-ImagesNegativeTestJSON-1570792871 tempest-ImagesNegativeTestJSON-1570792871-project-member] Enqueued Resource ID: 2f52b55d-af42-4f78-8a03-21345e5ab75d with Priority: HIGHEST for action security_group_members [ 795.718409] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f52b55d-af42-4f78-8a03-21345e5ab75d with Priority: HIGHEST for action security_group_members [ 795.718710] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f52b55d-af42-4f78-8a03-21345e5ab75d taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.718847] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f52b55d-af42-4f78-8a03-21345e5ab75d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.718900] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f52b55d-af42-4f78-8a03-21345e5ab75d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.719440] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f52b55d-af42-4f78-8a03-21345e5ab75d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.719621] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.719726] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.719792] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.719957] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.720055] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.720170] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f52b55d-af42-4f78-8a03-21345e5ab75d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.965590] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.965671] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.966610] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.966610] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.966610] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.966610] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.966610] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.966610] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.966610] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.966610] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.967758] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c81f5e-9888-4914-ab90-42d06116db49 is going to be updated. [ 795.997155] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.997316] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.997357] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.998145] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.998145] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.007718] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c81f5e-9888-4914-ab90-42d06116db49 in Status: IN_PROGRESS for 2s [ 796.068363] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.068524] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.068598] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.068966] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.069081] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.069177] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.069177] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.069353] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.070035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.070035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.070035] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.070035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.070035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.070035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.070327] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.070327] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.070327] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.070444] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.070444] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.070541] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.070651] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cddfb2d8-8ac5-496b-aee4-ea09e6b59edf',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.226192] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.226192] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.226192] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.226192] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.226192] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.226192] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.226192] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.226192] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.226192] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.226192] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.226192] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f52b55d-af42-4f78-8a03-21345e5ab75d is going to be updated. [ 796.254807] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.254966] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.255051] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.255275] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.255424] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.266633] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f52b55d-af42-4f78-8a03-21345e5ab75d in Status: IN_PROGRESS for 2s [ 796.572719] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cddfb2d8-8ac5-496b-aee4-ea09e6b59edf: rpc.has_security_group_logging(os_id): False [ 796.593040] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.593212] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.593464] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.593944] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.594064] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.594300] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.594402] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.594463] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.594643] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.594711] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.594917] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.595076] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.595076] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.595279] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.595380] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.595577] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.595710] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.595770] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.595927] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.596016] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.596539] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf is going to be created. [ 796.654293] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.654447] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.654515] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.654743] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.654931] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.667454] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf in Status: IN_PROGRESS for 2s [ 798.018776] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c81f5e-9888-4914-ab90-42d06116db49 in Status: SUCCESS [ 798.018776] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c81f5e-9888-4914-ab90-42d06116db49 deletion is rescheduled due to dependency. [ 798.018776] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.276113] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f52b55d-af42-4f78-8a03-21345e5ab75d in Status: SUCCESS [ 798.276356] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f52b55d-af42-4f78-8a03-21345e5ab75d deletion is rescheduled due to dependency. [ 798.276503] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f52b55d-af42-4f78-8a03-21345e5ab75d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.682185] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf in Status: SUCCESS [ 798.682402] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.719417] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 800.719417] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 803.520253] env[65943]: INFO networking_nsxv3.common.synchronization [None req-3a9015f5-f2ac-4e99-9ce5-cc66ab388373 tempest-ImagesOneServerNegativeTestJSON-477600040 tempest-ImagesOneServerNegativeTestJSON-477600040-project-member] Enqueued Resource ID: 6301e773-d60f-4a92-8d01-7fa4614183e9 with Priority: HIGHEST for action security_group_rules [ 803.520778] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6301e773-d60f-4a92-8d01-7fa4614183e9 with Priority: HIGHEST for action security_group_rules [ 803.521086] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6301e773-d60f-4a92-8d01-7fa4614183e9 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.521208] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6301e773-d60f-4a92-8d01-7fa4614183e9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.521268] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6301e773-d60f-4a92-8d01-7fa4614183e9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.521517] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6301e773-d60f-4a92-8d01-7fa4614183e9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.521600] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6301e773-d60f-4a92-8d01-7fa4614183e9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.637665] env[65943]: INFO networking_nsxv3.common.synchronization [None req-6dc075ec-561c-43bf-b218-2f635306c086 tempest-ImagesOneServerNegativeTestJSON-477600040 tempest-ImagesOneServerNegativeTestJSON-477600040-project-member] Enqueued Resource ID: 6301e773-d60f-4a92-8d01-7fa4614183e9 with Priority: HIGHEST for action security_group_rules [ 803.638013] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6301e773-d60f-4a92-8d01-7fa4614183e9 with Priority: HIGHEST for action security_group_rules [ 803.638289] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6301e773-d60f-4a92-8d01-7fa4614183e9 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.638386] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6301e773-d60f-4a92-8d01-7fa4614183e9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.047386] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.047549] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.047614] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.047873] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.048025] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.048185] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6301e773-d60f-4a92-8d01-7fa4614183e9 already deleted. [ 804.048323] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6301e773-d60f-4a92-8d01-7fa4614183e9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.048543] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6301e773-d60f-4a92-8d01-7fa4614183e9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.048778] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6301e773-d60f-4a92-8d01-7fa4614183e9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.048915] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6301e773-d60f-4a92-8d01-7fa4614183e9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.572578] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.572578] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.572578] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.573102] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.573102] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.573102] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6301e773-d60f-4a92-8d01-7fa4614183e9 already deleted. [ 804.573102] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6301e773-d60f-4a92-8d01-7fa4614183e9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.971462] env[65943]: INFO networking_nsxv3.common.synchronization [req-d2f33982-6151-4e31-95c8-4c45b4d8ca55 req-c56dbff5-2bd7-464e-8bb2-c8ed299047ff tempest-FloatingIPsAssociationTestJSON-462341531 tempest-FloatingIPsAssociationTestJSON-462341531-project-member] Enqueued Resource ID: 9a29bac0-8e63-4f6f-957d-9bd116500c7e with Priority: HIGHEST for action security_group_members [ 804.971660] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a29bac0-8e63-4f6f-957d-9bd116500c7e with Priority: HIGHEST for action security_group_members [ 804.971954] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a29bac0-8e63-4f6f-957d-9bd116500c7e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.974430] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.974535] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.974738] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.974919] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.975039] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.975103] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.975261] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.975375] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.975443] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a29bac0-8e63-4f6f-957d-9bd116500c7e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.478559] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.478713] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.478787] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.479120] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.479120] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.479339] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.479437] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.479497] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.479649] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.479726] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.479934] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a29bac0-8e63-4f6f-957d-9bd116500c7e is going to be updated. [ 805.515178] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.515440] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.515440] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.515604] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.515748] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.525028] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a29bac0-8e63-4f6f-957d-9bd116500c7e in Status: IN_PROGRESS for 2s [ 806.299798] env[65943]: INFO networking_nsxv3.common.synchronization [req-280fe8ac-87d9-418d-bb56-093ba684569e req-6556d08f-e39d-4a08-b1f6-d7b4c6d48cef tempest-ListServersNegativeTestJSON-1591552957 tempest-ListServersNegativeTestJSON-1591552957-project-member] Enqueued Resource ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf with Priority: HIGHEST for action security_group_members [ 806.300456] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf with Priority: HIGHEST for action security_group_members [ 806.300868] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.301053] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.301193] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.301439] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.301632] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.301757] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.301818] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.302057] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.302149] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.302265] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cddfb2d8-8ac5-496b-aee4-ea09e6b59edf',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.687043] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-496 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.688029] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-496" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.688029] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-496" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.688029] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-496" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.688029] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.692042] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.692316] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.692814] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.692814] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.692957] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 806.693111] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 806.693196] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 806.693283] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 806.693390] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 806.693488] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 806.693620] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 806.716141] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 806.716298] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 806.716429] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 806.716597] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-496" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.717066] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-e41af013-529b-4a8f-9ee0-01f1b6c6b8bc taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.717172] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-e41af013-529b-4a8f-9ee0-01f1b6c6b8bc" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.717289] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-e41af013-529b-4a8f-9ee0-01f1b6c6b8bc" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.717620] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-e41af013-529b-4a8f-9ee0-01f1b6c6b8bc" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.717796] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e41af013-529b-4a8f-9ee0-01f1b6c6b8bc',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.805055] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cddfb2d8-8ac5-496b-aee4-ea09e6b59edf',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.220374] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.220587] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.221171] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.221171] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.221579] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.221579] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port e41af013-529b-4a8f-9ee0-01f1b6c6b8bc not found, creating... [ 807.221848] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.222072] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.222197] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.222498] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.222708] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.223113] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.223342] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.223514] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.223780] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.223923] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.224117] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: e41af013-529b-4a8f-9ee0-01f1b6c6b8bc is going to be created. [ 807.249794] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.250039] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.250231] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.250554] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.250778] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.250993] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-e41af013-529b-4a8f-9ee0-01f1b6c6b8bc" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.309076] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cddfb2d8-8ac5-496b-aee4-ea09e6b59edf',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.535312] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a29bac0-8e63-4f6f-957d-9bd116500c7e in Status: SUCCESS [ 807.535543] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a29bac0-8e63-4f6f-957d-9bd116500c7e deletion is rescheduled due to dependency. [ 807.535615] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a29bac0-8e63-4f6f-957d-9bd116500c7e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.813461] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.813670] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.813734] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.813896] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.813991] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.814749] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf is going to be updated. [ 807.850275] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.850275] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.850275] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.850275] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.850275] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.861336] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf in Status: IN_PROGRESS for 2s [ 807.957140] env[65943]: INFO networking_nsxv3.common.synchronization [req-280fe8ac-87d9-418d-bb56-093ba684569e req-2fe6ada0-faad-49ce-a147-b72bd9be796c service nova] Enqueued Resource ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf with Priority: HIGHEST for action security_group_rules [ 807.957553] env[65943]: INFO networking_nsxv3.common.synchronization [req-280fe8ac-87d9-418d-bb56-093ba684569e req-2fe6ada0-faad-49ce-a147-b72bd9be796c service nova] Enqueued Resource ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf with Priority: HIGHEST for action security_group_members [ 807.957553] env[65943]: INFO networking_nsxv3.common.synchronization [req-280fe8ac-87d9-418d-bb56-093ba684569e req-2fe6ada0-faad-49ce-a147-b72bd9be796c service nova] Enqueued Resource ID: e41af013-529b-4a8f-9ee0-01f1b6c6b8bc with Priority: HIGHEST for action port [ 807.958079] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf with Priority: HIGHEST for action security_group_rules [ 807.958239] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf with Priority: HIGHEST for action security_group_members [ 807.958351] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e41af013-529b-4a8f-9ee0-01f1b6c6b8bc with Priority: HIGHEST for action port [ 807.958641] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.958765] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.958829] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.959063] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.959169] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cddfb2d8-8ac5-496b-aee4-ea09e6b59edf',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.960016] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.960116] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.960304] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-e41af013-529b-4a8f-9ee0-01f1b6c6b8bc taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.960400] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e41af013-529b-4a8f-9ee0-01f1b6c6b8bc" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.960461] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e41af013-529b-4a8f-9ee0-01f1b6c6b8bc" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.960632] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e41af013-529b-4a8f-9ee0-01f1b6c6b8bc" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.960704] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e41af013-529b-4a8f-9ee0-01f1b6c6b8bc',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.464164] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.464432] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.464432] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e41af013-529b-4a8f-9ee0-01f1b6c6b8bc with status ACTIVE [ 808.464620] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.464726] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.464784] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.465038] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.465117] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.465406] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.465406] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.465536] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.465583] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.465715] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.465846] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.465937] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.465984] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.466136] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.466209] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.466289] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e41af013-529b-4a8f-9ee0-01f1b6c6b8bc is going to be updated. [ 808.487826] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.488028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.488105] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.488321] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.488448] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.488607] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e41af013-529b-4a8f-9ee0-01f1b6c6b8bc" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.627215] env[65943]: INFO networking_nsxv3.common.synchronization [req-991eb365-b223-46ed-bce0-d34fb616d8bf req-bb386c0c-2bee-463b-b68a-2af9e0c429d6 tempest-ListServerFiltersTestJSON-237143396 tempest-ListServerFiltersTestJSON-237143396-project-member] Enqueued Resource ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e with Priority: HIGHEST for action security_group_members [ 808.627916] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e with Priority: HIGHEST for action security_group_members [ 808.628428] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8fad12-41c9-413e-91de-8c1ff3cf914e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.628573] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.628640] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.628843] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.629014] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.629194] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.629256] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.629454] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.629454] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.629561] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d8fad12-41c9-413e-91de-8c1ff3cf914e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.897592] env[65943]: INFO networking_nsxv3.common.synchronization [req-280fe8ac-87d9-418d-bb56-093ba684569e req-791a2509-f507-48eb-9550-6a8e797ccec3 tempest-ListServersNegativeTestJSON-1591552957 tempest-ListServersNegativeTestJSON-1591552957-project-member] Enqueued Resource ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf with Priority: HIGHEST for action security_group_members [ 808.898203] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf with Priority: HIGHEST for action security_group_members [ 808.898511] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.898628] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.134483] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d8fad12-41c9-413e-91de-8c1ff3cf914e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.267152] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-496 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.267510] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-496" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.267668] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-496" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.268044] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-496" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.268379] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.268587] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.268710] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.268984] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.269177] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.269390] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 809.269498] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 809.269599] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 809.269700] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 809.269804] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 809.269902] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 809.270038] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 809.290316] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 809.290496] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 809.290549] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 809.290714] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-496" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.291240] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-9f9035e2-6fe4-4fde-a8d0-9dbb5c8414fa taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.291240] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-9f9035e2-6fe4-4fde-a8d0-9dbb5c8414fa" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.291401] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-9f9035e2-6fe4-4fde-a8d0-9dbb5c8414fa" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.291635] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-9f9035e2-6fe4-4fde-a8d0-9dbb5c8414fa" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.291778] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f9035e2-6fe4-4fde-a8d0-9dbb5c8414fa',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.635892] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d8fad12-41c9-413e-91de-8c1ff3cf914e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.794711] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.794927] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.795062] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.795352] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.795501] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.795646] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port 9f9035e2-6fe4-4fde-a8d0-9dbb5c8414fa not found, creating... [ 809.795898] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.796071] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.796190] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.796397] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.796529] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.796847] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.797023] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.797087] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.797275] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.797399] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.797529] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: 9f9035e2-6fe4-4fde-a8d0-9dbb5c8414fa is going to be created. [ 809.819404] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.819658] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.819778] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.820080] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.820308] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.820527] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-9f9035e2-6fe4-4fde-a8d0-9dbb5c8414fa" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.874559] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf in Status: SUCCESS [ 809.874559] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.874559] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.874559] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.874559] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.874559] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.874559] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.874988] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.874988] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.875060] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cddfb2d8-8ac5-496b-aee4-ea09e6b59edf',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.138827] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.139066] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.139182] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.140117] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.140117] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.140117] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e is going to be updated. [ 810.172135] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.172135] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.172135] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.172348] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.172462] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.183579] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e in Status: IN_PROGRESS for 2s [ 810.332362] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.332530] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.332605] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.332829] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.332970] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.377661] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cddfb2d8-8ac5-496b-aee4-ea09e6b59edf',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.528980] env[65943]: INFO networking_nsxv3.common.synchronization [req-280fe8ac-87d9-418d-bb56-093ba684569e req-dc93a73b-af47-42d0-a455-9acc7a17030d service nova] Enqueued Resource ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf with Priority: HIGHEST for action security_group_rules [ 810.529320] env[65943]: INFO networking_nsxv3.common.synchronization [req-280fe8ac-87d9-418d-bb56-093ba684569e req-dc93a73b-af47-42d0-a455-9acc7a17030d service nova] Enqueued Resource ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf with Priority: HIGHEST for action security_group_members [ 810.529530] env[65943]: INFO networking_nsxv3.common.synchronization [req-280fe8ac-87d9-418d-bb56-093ba684569e req-dc93a73b-af47-42d0-a455-9acc7a17030d service nova] Enqueued Resource ID: 9f9035e2-6fe4-4fde-a8d0-9dbb5c8414fa with Priority: HIGHEST for action port [ 810.530500] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf with Priority: HIGHEST for action security_group_rules [ 810.530500] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf with Priority: HIGHEST for action security_group_members [ 810.530500] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f9035e2-6fe4-4fde-a8d0-9dbb5c8414fa with Priority: HIGHEST for action port [ 810.530500] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.530851] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.530851] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.530851] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.530992] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f9035e2-6fe4-4fde-a8d0-9dbb5c8414fa taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.531106] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f9035e2-6fe4-4fde-a8d0-9dbb5c8414fa" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.531138] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f9035e2-6fe4-4fde-a8d0-9dbb5c8414fa" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.531339] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f9035e2-6fe4-4fde-a8d0-9dbb5c8414fa" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.531450] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f9035e2-6fe4-4fde-a8d0-9dbb5c8414fa',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.835098] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.880761] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cddfb2d8-8ac5-496b-aee4-ea09e6b59edf',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.033763] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9f9035e2-6fe4-4fde-a8d0-9dbb5c8414fa with status ACTIVE [ 811.033995] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.034143] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.034209] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.034417] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.034519] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.034759] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.034852] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.034916] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.035088] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.035157] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.035442] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.035442] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.035521] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.035613] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.035683] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.035764] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9f9035e2-6fe4-4fde-a8d0-9dbb5c8414fa is going to be updated. [ 811.060065] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.060065] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.060065] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.060065] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.060429] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.060429] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f9035e2-6fe4-4fde-a8d0-9dbb5c8414fa" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.337939] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.382941] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.383240] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.383240] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.383478] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.383611] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.383761] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf is going to be updated. [ 811.415132] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.415316] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.415356] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.416314] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.416314] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.426028] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf in Status: IN_PROGRESS for 2s [ 811.570891] env[65943]: INFO networking_nsxv3.common.synchronization [req-2df81ae2-50d2-4293-8573-f76d58048f80 req-d457eb9f-ee49-4f8e-80c3-122f25a7901e tempest-ServersV294TestFqdnHostnames-134123508 tempest-ServersV294TestFqdnHostnames-134123508-project-member] Enqueued Resource ID: 6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b with Priority: HIGHEST for action security_group_members [ 811.571481] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b with Priority: HIGHEST for action security_group_members [ 811.572311] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.572311] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.572311] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.572311] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.572651] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.572784] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.572901] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.573175] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.573228] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.573341] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.839922] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 811.840441] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 811.969676] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-835 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.969676] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-835" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.969676] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-835" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.969676] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-835" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.969945] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.970059] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.970171] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.971035] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.971035] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.971035] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 811.971035] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 811.971035] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 811.971339] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 811.971339] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 811.971339] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 811.971463] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 811.992427] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 811.992616] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 811.992752] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 811.992923] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-835" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.993259] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-cef3cc94-5067-47a7-9acb-fa0ca18115da taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.993425] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-cef3cc94-5067-47a7-9acb-fa0ca18115da" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.993539] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-cef3cc94-5067-47a7-9acb-fa0ca18115da" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.994110] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-cef3cc94-5067-47a7-9acb-fa0ca18115da" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.994110] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cef3cc94-5067-47a7-9acb-fa0ca18115da',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.075246] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.075438] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.075503] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.075672] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.075772] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.075962] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.076181] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.076181] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.076932] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.077046] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.077141] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b already deleted. [ 812.077226] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.198190] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e in Status: SUCCESS [ 812.198190] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.500023] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.500023] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.500023] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.500023] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.500023] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.500023] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port cef3cc94-5067-47a7-9acb-fa0ca18115da not found, creating... [ 812.500023] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.500023] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.500023] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.500023] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.500023] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.500604] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.500604] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.500604] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.500604] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.500604] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.500789] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: cef3cc94-5067-47a7-9acb-fa0ca18115da is going to be created. [ 812.520490] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.520836] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.521013] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.521390] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.521711] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.522032] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-cef3cc94-5067-47a7-9acb-fa0ca18115da" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.697038] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.697038] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.697038] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.697038] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.708434] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 812.709463] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.710688] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 812.748091] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.748264] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.748355] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.748532] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.755142] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.755693] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:1. [ 812.755791] env[65943]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:{'9f9035e2-6fe4-4fde-a8d0-9dbb5c8414fa'} {{(pid=65943) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 812.755854] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 812.795943] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.796123] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.796123] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.796282] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.797670] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.797885] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 812.859755] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.860123] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.860123] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.860215] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.860428] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.860666] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 812.921061] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.921206] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.921285] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.921478] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.921733] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.921950] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:36. [ 812.923367] env[65943]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'a4f83bf4-ed34-4088-a422-46a4d9e5c7e1', 'fec81ce3-7d2a-43a6-b4de-83696a200925', '22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b', '7544afbe-03f8-421e-b9ed-b038f61ffc17', '78f53cda-281e-4098-b286-926afd0b084e', 'f706a4bc-cb3d-42f0-9e3b-9871aac4d673', 'bf5449c8-e110-49bf-b5ea-dcfeefaf5d48', '2f52b55d-af42-4f78-8a03-21345e5ab75d', '4d778131-5833-4ecf-9479-3c14db301ff2', 'e02be8c7-70b1-4488-b079-b1ebf20a733c', '3d8fad12-41c9-413e-91de-8c1ff3cf914e', '91dead58-0cf0-4aec-a2ae-571f8dc59b4c', '4b23ffb1-731f-42f8-bb4b-c106291be34d', '27b85908-8ec4-43b9-a75f-406d0e56ea98', 'ab9efec0-c13a-4960-afb7-a800c8e897d8', '7bcdadce-edf2-43d0-a8d9-43033bb27e63', 'df0b5076-3338-4b40-9ce6-994130c4b8d2', 'e550f237-9e27-45ea-9e02-516ac8d2852f', '4d0b6f8c-385a-4740-8634-e522537eba0d', 'c0c81f5e-9888-4914-ab90-42d06116db49', '55c4b60d-641f-4044-8228-251f73d38ecb', '68884628-4b38-403c-8fad-e29dfea783b0', 'f293d027-3f3e-402a-bfe6-98af5d29163f', 'd97ff6f8-41cc-4974-82fe-bda7247ceb2b', '82c62f05-41a4-43fb-a74d-0baaee3b8043', '75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a', 'bad8ffbf-a375-4ee1-b522-c5e84af1b840', '8c8a054b-6bee-465e-84da-d50dfdc27f64', '3e3d8b17-4394-4674-b793-075706514abb', 'c9b127ff-135f-4cd2-9456-bc11d98737ce', '9a29bac0-8e63-4f6f-957d-9bd116500c7e', '1059706e-9846-4d25-98c7-43c5aa686d19', 'b88e0956-a799-4c5e-8e71-323151811fd1', '9539d191-87a5-4727-b693-a846f1e6f855', 'dcee84a2-5f8e-4aff-856c-81b817d31434', 'cddfb2d8-8ac5-496b-aee4-ea09e6b59edf'} {{(pid=65943) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 812.923367] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 812.949165] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.949346] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.949346] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.949523] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.949618] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.949741] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 812.949816] env[65943]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65943) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 812.949903] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 813.010877] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.011031] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.011098] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.011312] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.012081] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.012382] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 813.012470] env[65943]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65943) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 813.012526] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 813.012577] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 1/1 resources of Type:Ports [ 813.012675] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9f9035e2-6fe4-4fde-a8d0-9dbb5c8414fa with Priority: HIGH for action port [ 813.012795] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 19/36 resources of Type:Security Group Rules [ 813.012879] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 with Priority: HIGH for action security_group_rules [ 813.012967] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fec81ce3-7d2a-43a6-b4de-83696a200925 with Priority: HIGH for action security_group_rules [ 813.013063] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b with Priority: HIGH for action security_group_rules [ 813.013465] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 with Priority: HIGH for action security_group_rules [ 813.013465] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 78f53cda-281e-4098-b286-926afd0b084e with Priority: HIGH for action security_group_rules [ 813.013465] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f706a4bc-cb3d-42f0-9e3b-9871aac4d673 with Priority: HIGH for action security_group_rules [ 813.013465] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bf5449c8-e110-49bf-b5ea-dcfeefaf5d48 with Priority: HIGH for action security_group_rules [ 813.013465] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2f52b55d-af42-4f78-8a03-21345e5ab75d with Priority: HIGH for action security_group_rules [ 813.013671] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4d778131-5833-4ecf-9479-3c14db301ff2 with Priority: HIGH for action security_group_rules [ 813.013671] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e02be8c7-70b1-4488-b079-b1ebf20a733c with Priority: HIGH for action security_group_rules [ 813.013752] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e with Priority: HIGH for action security_group_rules [ 813.013855] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 91dead58-0cf0-4aec-a2ae-571f8dc59b4c with Priority: HIGH for action security_group_rules [ 813.013855] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d with Priority: HIGH for action security_group_rules [ 813.013923] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 27b85908-8ec4-43b9-a75f-406d0e56ea98 with Priority: HIGH for action security_group_rules [ 813.013973] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ab9efec0-c13a-4960-afb7-a800c8e897d8 with Priority: HIGH for action security_group_rules [ 813.014090] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 with Priority: HIGH for action security_group_rules [ 813.014176] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 with Priority: HIGH for action security_group_rules [ 813.014254] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e550f237-9e27-45ea-9e02-516ac8d2852f with Priority: HIGH for action security_group_rules [ 813.014328] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4d0b6f8c-385a-4740-8634-e522537eba0d with Priority: HIGH for action security_group_rules [ 813.014442] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.242210] env[65943]: INFO networking_nsxv3.common.synchronization [req-2df81ae2-50d2-4293-8573-f76d58048f80 req-a3546195-afbb-438a-b6b0-eafb5535c80e service nova] Enqueued Resource ID: 6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b with Priority: HIGHEST for action security_group_rules [ 813.242475] env[65943]: INFO networking_nsxv3.common.synchronization [req-2df81ae2-50d2-4293-8573-f76d58048f80 req-a3546195-afbb-438a-b6b0-eafb5535c80e service nova] Enqueued Resource ID: 6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b with Priority: HIGHEST for action security_group_members [ 813.242642] env[65943]: INFO networking_nsxv3.common.synchronization [req-2df81ae2-50d2-4293-8573-f76d58048f80 req-a3546195-afbb-438a-b6b0-eafb5535c80e service nova] Enqueued Resource ID: cef3cc94-5067-47a7-9acb-fa0ca18115da with Priority: HIGHEST for action port [ 813.243198] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b with Priority: HIGHEST for action security_group_rules [ 813.243349] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b with Priority: HIGHEST for action security_group_members [ 813.243470] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cef3cc94-5067-47a7-9acb-fa0ca18115da with Priority: HIGHEST for action port [ 813.243617] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f9035e2-6fe4-4fde-a8d0-9dbb5c8414fa with Priority: HIGH for action port [ 813.243757] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fec81ce3-7d2a-43a6-b4de-83696a200925 with Priority: HIGH for action security_group_rules [ 813.243920] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f706a4bc-cb3d-42f0-9e3b-9871aac4d673 with Priority: HIGH for action security_group_rules [ 813.243976] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27b85908-8ec4-43b9-a75f-406d0e56ea98 with Priority: HIGH for action security_group_rules [ 813.244344] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d0b6f8c-385a-4740-8634-e522537eba0d with Priority: HIGH for action security_group_rules [ 813.244344] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e550f237-9e27-45ea-9e02-516ac8d2852f with Priority: HIGH for action security_group_rules [ 813.244344] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 with Priority: HIGH for action security_group_rules [ 813.244344] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 with Priority: HIGH for action security_group_rules [ 813.244511] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d with Priority: HIGH for action security_group_rules [ 813.244511] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab9efec0-c13a-4960-afb7-a800c8e897d8 with Priority: HIGH for action security_group_rules [ 813.244663] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91dead58-0cf0-4aec-a2ae-571f8dc59b4c with Priority: HIGH for action security_group_rules [ 813.244726] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e with Priority: HIGH for action security_group_rules [ 813.244857] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e02be8c7-70b1-4488-b079-b1ebf20a733c with Priority: HIGH for action security_group_rules [ 813.244964] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d778131-5833-4ecf-9479-3c14db301ff2 with Priority: HIGH for action security_group_rules [ 813.245242] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f52b55d-af42-4f78-8a03-21345e5ab75d with Priority: HIGH for action security_group_rules [ 813.245352] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78f53cda-281e-4098-b286-926afd0b084e with Priority: HIGH for action security_group_rules [ 813.245524] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf5449c8-e110-49bf-b5ea-dcfeefaf5d48 with Priority: HIGH for action security_group_rules [ 813.245625] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 with Priority: HIGH for action security_group_rules [ 813.245708] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 with Priority: HIGH for action security_group_rules [ 813.245840] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b with Priority: HIGH for action security_group_rules [ 813.246100] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.246222] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.246287] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.246499] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.246586] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.247971] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.248219] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.248293] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.248473] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.248631] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.248721] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.248782] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.248929] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.249027] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.249112] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.250233] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-cef3cc94-5067-47a7-9acb-fa0ca18115da taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.250367] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cef3cc94-5067-47a7-9acb-fa0ca18115da" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.250524] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cef3cc94-5067-47a7-9acb-fa0ca18115da" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.250605] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cef3cc94-5067-47a7-9acb-fa0ca18115da" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.250605] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cef3cc94-5067-47a7-9acb-fa0ca18115da',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.253417] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f9035e2-6fe4-4fde-a8d0-9dbb5c8414fa taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.253800] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f9035e2-6fe4-4fde-a8d0-9dbb5c8414fa" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.253874] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f9035e2-6fe4-4fde-a8d0-9dbb5c8414fa" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.254203] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f9035e2-6fe4-4fde-a8d0-9dbb5c8414fa" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.254203] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f9035e2-6fe4-4fde-a8d0-9dbb5c8414fa',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.255468] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fec81ce3-7d2a-43a6-b4de-83696a200925 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.255468] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fec81ce3-7d2a-43a6-b4de-83696a200925" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.255468] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fec81ce3-7d2a-43a6-b4de-83696a200925" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.255654] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fec81ce3-7d2a-43a6-b4de-83696a200925" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.255654] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fec81ce3-7d2a-43a6-b4de-83696a200925',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.256292] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f706a4bc-cb3d-42f0-9e3b-9871aac4d673 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.256395] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f706a4bc-cb3d-42f0-9e3b-9871aac4d673" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.256464] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f706a4bc-cb3d-42f0-9e3b-9871aac4d673" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.257283] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f706a4bc-cb3d-42f0-9e3b-9871aac4d673" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.257283] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f706a4bc-cb3d-42f0-9e3b-9871aac4d673',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.258124] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-27b85908-8ec4-43b9-a75f-406d0e56ea98 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.258222] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-27b85908-8ec4-43b9-a75f-406d0e56ea98" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.258289] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-27b85908-8ec4-43b9-a75f-406d0e56ea98" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.258437] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-27b85908-8ec4-43b9-a75f-406d0e56ea98" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.258528] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('27b85908-8ec4-43b9-a75f-406d0e56ea98',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.261134] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d0b6f8c-385a-4740-8634-e522537eba0d taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.261134] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d0b6f8c-385a-4740-8634-e522537eba0d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.261134] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d0b6f8c-385a-4740-8634-e522537eba0d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.261134] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d0b6f8c-385a-4740-8634-e522537eba0d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.261134] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d0b6f8c-385a-4740-8634-e522537eba0d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.262468] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e550f237-9e27-45ea-9e02-516ac8d2852f taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.262651] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.262705] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.262856] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.262911] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e550f237-9e27-45ea-9e02-516ac8d2852f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.263860] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df0b5076-3338-4b40-9ce6-994130c4b8d2 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.263969] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.264509] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.264722] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.264846] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df0b5076-3338-4b40-9ce6-994130c4b8d2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.266496] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.266608] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.266652] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.266875] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.267476] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7bcdadce-edf2-43d0-a8d9-43033bb27e63',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.267545] env[65943]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 813.268787] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b23ffb1-731f-42f8-bb4b-c106291be34d taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.268895] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.268972] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.269371] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.269433] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b23ffb1-731f-42f8-bb4b-c106291be34d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.270379] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab9efec0-c13a-4960-afb7-a800c8e897d8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.270510] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab9efec0-c13a-4960-afb7-a800c8e897d8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.270567] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab9efec0-c13a-4960-afb7-a800c8e897d8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.270789] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab9efec0-c13a-4960-afb7-a800c8e897d8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.270916] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab9efec0-c13a-4960-afb7-a800c8e897d8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.271898] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-91dead58-0cf0-4aec-a2ae-571f8dc59b4c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.272026] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-91dead58-0cf0-4aec-a2ae-571f8dc59b4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.272822] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-91dead58-0cf0-4aec-a2ae-571f8dc59b4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.273323] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-91dead58-0cf0-4aec-a2ae-571f8dc59b4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.273323] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('91dead58-0cf0-4aec-a2ae-571f8dc59b4c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.275606] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d8fad12-41c9-413e-91de-8c1ff3cf914e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.275606] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.275606] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.275606] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.275606] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d8fad12-41c9-413e-91de-8c1ff3cf914e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.276273] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e02be8c7-70b1-4488-b079-b1ebf20a733c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.276395] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.276485] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.276681] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.276762] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.277989] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d778131-5833-4ecf-9479-3c14db301ff2 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.278149] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d778131-5833-4ecf-9479-3c14db301ff2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.278149] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d778131-5833-4ecf-9479-3c14db301ff2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.278386] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d778131-5833-4ecf-9479-3c14db301ff2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.278386] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d778131-5833-4ecf-9479-3c14db301ff2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.280424] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f52b55d-af42-4f78-8a03-21345e5ab75d taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.280424] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f52b55d-af42-4f78-8a03-21345e5ab75d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.280424] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f52b55d-af42-4f78-8a03-21345e5ab75d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.280424] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f52b55d-af42-4f78-8a03-21345e5ab75d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.280424] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f52b55d-af42-4f78-8a03-21345e5ab75d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.282149] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78f53cda-281e-4098-b286-926afd0b084e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.282276] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78f53cda-281e-4098-b286-926afd0b084e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.282339] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78f53cda-281e-4098-b286-926afd0b084e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.283149] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78f53cda-281e-4098-b286-926afd0b084e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.283272] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78f53cda-281e-4098-b286-926afd0b084e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.284780] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.284930] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.284980] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.285155] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.285233] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf5449c8-e110-49bf-b5ea-dcfeefaf5d48',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.286824] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7544afbe-03f8-421e-b9ed-b038f61ffc17 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.286961] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.287123] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.287317] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.287399] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7544afbe-03f8-421e-b9ed-b038f61ffc17',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.287635] env[65943]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 813.288358] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.288940] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.288940] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.288940] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.288940] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4f83bf4-ed34-4088-a422-46a4d9e5c7e1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.289506] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.289607] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.289670] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.289814] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.289883] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.437729] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf in Status: SUCCESS [ 813.437976] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.438773] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.438936] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.439149] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.440352] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.440456] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.440637] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.440725] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.440810] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.440908] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cddfb2d8-8ac5-496b-aee4-ea09e6b59edf',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.444189] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.444388] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.444596] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.444699] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.444749] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.444880] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.444976] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.445093] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cddfb2d8-8ac5-496b-aee4-ea09e6b59edf',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.748435] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.748670] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.750628] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.756551] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9f9035e2-6fe4-4fde-a8d0-9dbb5c8414fa with status ACTIVE [ 813.756551] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.756761] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.756761] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.757199] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.757199] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.757346] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.757434] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.757492] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.757648] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.757719] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.757927] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.758067] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.758128] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.758222] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.758295] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.758378] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9f9035e2-6fe4-4fde-a8d0-9dbb5c8414fa is going to be updated. [ 813.779044] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.779222] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.779355] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.779509] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.779646] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.779867] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f9035e2-6fe4-4fde-a8d0-9dbb5c8414fa" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.798684] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cef3cc94-5067-47a7-9acb-fa0ca18115da with status ACTIVE [ 813.798898] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.799036] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.799103] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.799355] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.799460] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.799560] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.799659] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.799726] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.799930] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.800057] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.800308] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.800308] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.800720] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.800720] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.800720] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.800720] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cef3cc94-5067-47a7-9acb-fa0ca18115da is going to be updated. [ 813.812962] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.812962] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.812962] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.812962] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.817181] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.817181] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.828672] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e02be8c7-70b1-4488-b079-b1ebf20a733c taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.828891] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.829023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.829317] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.829585] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.829724] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.829790] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.829988] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.830119] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.830207] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.830315] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.834046] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.834185] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.834229] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.834409] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.834602] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.834926] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cef3cc94-5067-47a7-9acb-fa0ca18115da" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.836689] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.836808] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.837712] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.837712] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.837712] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.837712] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.837712] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.837712] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.837712] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.838062] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.838062] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.842126] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8fad12-41c9-413e-91de-8c1ff3cf914e taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.842283] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.842385] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.842567] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.842756] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.842817] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.842881] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.843034] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.843121] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.843482] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.843482] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3d8fad12-41c9-413e-91de-8c1ff3cf914e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.846737] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.847958] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.847958] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.847958] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.848153] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.848153] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.848242] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.849710] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.849710] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.849710] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.849710] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4f83bf4-ed34-4088-a422-46a4d9e5c7e1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.854512] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.854625] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f706a4bc-cb3d-42f0-9e3b-9871aac4d673 is going to be deleted. [ 813.862795] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7544afbe-03f8-421e-b9ed-b038f61ffc17 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.863253] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.863325] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.866443] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.866668] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.866789] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.866877] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.867083] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.867217] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.867270] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.867365] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7544afbe-03f8-421e-b9ed-b038f61ffc17',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.874177] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bcdadce-edf2-43d0-a8d9-43033bb27e63 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.874305] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.874423] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.874846] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.875027] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.875127] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.875189] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.875348] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.875436] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.875524] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.875657] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7bcdadce-edf2-43d0-a8d9-43033bb27e63',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.878086] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.878298] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.918694] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.918812] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.924727] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.924863] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.928553] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.928680] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.934396] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.934526] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.935533] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.935770] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.936592] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.936765] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.937587] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.937725] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.946682] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.947017] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.947942] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.948060] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.948254] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cddfb2d8-8ac5-496b-aee4-ea09e6b59edf',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.960347] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.960496] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.964366] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.964537] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.967411] env[65943]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 813.968127] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.968237] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.973224] env[65943]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 813.973716] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.973803] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fec81ce3-7d2a-43a6-b4de-83696a200925 is going to be deleted. [ 813.974894] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.975182] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.996234] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.996402] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d is going to be deleted. [ 813.997546] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.997819] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.023342] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.023504] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df0b5076-3338-4b40-9ce6-994130c4b8d2 is going to be deleted. [ 814.024494] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.024710] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.028178] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.028387] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.041578] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.041578] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.061810] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.061945] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d778131-5833-4ecf-9479-3c14db301ff2 is going to be deleted. [ 814.062912] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.063139] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.074588] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.074821] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.098633] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.098844] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.120970] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.121164] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d0b6f8c-385a-4740-8634-e522537eba0d is going to be deleted. [ 814.122310] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.122538] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.198061] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.198276] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78f53cda-281e-4098-b286-926afd0b084e is going to be deleted. [ 814.199199] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.199423] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.205934] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.206179] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.253886] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.254154] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f52b55d-af42-4f78-8a03-21345e5ab75d is going to be deleted. [ 814.255096] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.256768] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.257126] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.288896] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.289184] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab9efec0-c13a-4960-afb7-a800c8e897d8 is going to be deleted. [ 814.290059] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.290353] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.324185] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.324284] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.331129] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.331308] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 27b85908-8ec4-43b9-a75f-406d0e56ea98 is going to be deleted. [ 814.332339] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.332490] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.333737] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e02be8c7-70b1-4488-b079-b1ebf20a733c taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.333892] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.333892] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.334156] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.334290] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.334395] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.334472] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.335276] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.335276] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.335276] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.335276] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e02be8c7-70b1-4488-b079-b1ebf20a733c taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.335276] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.335276] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.335521] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.335521] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.335606] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.335727] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.335820] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.335923] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.335992] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.336102] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.352027] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.353638] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8fad12-41c9-413e-91de-8c1ff3cf914e taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.353638] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.353832] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.353876] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.354070] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.354176] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.354246] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.354352] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.354437] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.354549] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.354662] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8fad12-41c9-413e-91de-8c1ff3cf914e taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.354808] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.354808] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.355009] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.355263] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.355366] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.355483] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.355572] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.355693] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.355730] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.355842] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3d8fad12-41c9-413e-91de-8c1ff3cf914e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.361914] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.362060] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 91dead58-0cf0-4aec-a2ae-571f8dc59b4c is going to be deleted. [ 814.365037] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.365037] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.381623] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7544afbe-03f8-421e-b9ed-b038f61ffc17',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.383136] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4f83bf4-ed34-4088-a422-46a4d9e5c7e1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.386303] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7bcdadce-edf2-43d0-a8d9-43033bb27e63',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.396595] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.396595] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.400048] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.400201] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e550f237-9e27-45ea-9e02-516ac8d2852f is going to be deleted. [ 814.401368] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.401594] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.405273] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.405398] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.452318] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cddfb2d8-8ac5-496b-aee4-ea09e6b59edf',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.466336] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.466336] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.483186] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.483186] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.485403] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.485532] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.486804] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.486958] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf5449c8-e110-49bf-b5ea-dcfeefaf5d48 is going to be deleted. [ 814.487872] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.488261] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.488261] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.488424] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f706a4bc-cb3d-42f0-9e3b-9871aac4d673" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.488617] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.488770] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.488847] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.489045] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fec81ce3-7d2a-43a6-b4de-83696a200925" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.489560] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.489650] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.489733] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.489846] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.490023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.490183] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.490270] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.490369] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df0b5076-3338-4b40-9ce6-994130c4b8d2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.490497] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.490635] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.490709] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.490842] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d778131-5833-4ecf-9479-3c14db301ff2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.490945] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.491189] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.491189] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.491303] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d0b6f8c-385a-4740-8634-e522537eba0d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.491509] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.491568] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.491611] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.491698] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f52b55d-af42-4f78-8a03-21345e5ab75d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.491818] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.491957] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.492040] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.492146] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78f53cda-281e-4098-b286-926afd0b084e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.492266] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.492402] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.492474] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.492589] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab9efec0-c13a-4960-afb7-a800c8e897d8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.492708] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.492838] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.492912] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.493040] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-27b85908-8ec4-43b9-a75f-406d0e56ea98" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.493187] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.493325] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.493423] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.493534] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-91dead58-0cf0-4aec-a2ae-571f8dc59b4c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.591260] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.591260] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.591260] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.591476] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.591476] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.591543] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e550f237-9e27-45ea-9e02-516ac8d2852f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.693673] env[65943]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 814.694579] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.694579] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.694579] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.694917] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.695036] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.695202] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf5449c8-e110-49bf-b5ea-dcfeefaf5d48" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.757747] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.757989] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.758111] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.758243] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.758336] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.758437] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b is going to be created. [ 814.813159] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.813306] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.813468] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.813617] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.813680] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.831285] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b in Status: UNINITIALIZED for 2s [ 814.838783] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e02be8c7-70b1-4488-b079-b1ebf20a733c: rpc.has_security_group_logging(os_id): False [ 814.857863] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b: rpc.has_security_group_logging(os_id): False [ 814.860046] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3d8fad12-41c9-413e-91de-8c1ff3cf914e: rpc.has_security_group_logging(os_id): False [ 814.880223] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.880223] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.880223] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.880223] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.885645] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7544afbe-03f8-421e-b9ed-b038f61ffc17: rpc.has_security_group_logging(os_id): False [ 814.886801] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.886965] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.888103] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4f83bf4-ed34-4088-a422-46a4d9e5c7e1: rpc.has_security_group_logging(os_id): False [ 814.888561] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7bcdadce-edf2-43d0-a8d9-43033bb27e63: rpc.has_security_group_logging(os_id): False [ 814.890525] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.890525] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.913441] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.913556] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.914446] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.914546] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.916292] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.916426] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.923192] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.924061] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.924061] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.924061] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.924061] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.924061] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.924342] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.924342] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.924342] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.924455] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.924520] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.924734] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.924796] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.924975] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.925202] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.925309] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.925429] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e02be8c7-70b1-4488-b079-b1ebf20a733c is going to be updated. [ 814.926615] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.927273] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.950946] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.951286] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.951399] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.951455] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.951642] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.951724] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.951816] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b is going to be updated. [ 814.952870] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.953050] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.954060] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.954181] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.954248] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.954400] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.954483] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.954570] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf is going to be updated. [ 814.979573] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.979573] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.979573] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.979573] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.979965] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.979965] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.979965] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 is going to be updated. [ 814.980932] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.981108] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.003865] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.004069] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.004069] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.004281] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.004420] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.006794] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.007131] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.007263] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.007335] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.007490] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.007564] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.007626] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 is going to be updated. [ 815.008593] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.008749] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.013360] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.013558] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.018746] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf in Status: IN_PROGRESS for 2s [ 815.035433] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.035647] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.048985] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.049392] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.049489] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.049559] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.049779] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.049889] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.050055] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 is going to be updated. [ 815.051383] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.051531] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.062989] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.063231] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.107560] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.107999] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.108151] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.108221] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.108595] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.108779] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.109193] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.109345] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.109431] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.109632] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.110414] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.110414] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.110414] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.110414] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.110641] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.111105] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.111105] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e is going to be updated. [ 815.112578] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.112662] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.112779] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.113929] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.114370] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.114370] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.115322] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.115479] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.115610] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.166156] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.166386] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.166496] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.166864] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.167166] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.225054] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e02be8c7-70b1-4488-b079-b1ebf20a733c in Status: IN_PROGRESS for 2s [ 815.226045] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 in Status: IN_PROGRESS for 2s [ 815.229639] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.229898] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.229898] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.230989] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.230989] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.235234] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b in Status: IN_PROGRESS for 2s [ 815.251975] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 in Status: IN_PROGRESS for 2s [ 815.262933] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 in Status: IN_PROGRESS for 2s [ 815.347986] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.348571] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.348666] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.348942] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.349234] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.384463] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e in Status: IN_PROGRESS for 2s [ 815.638120] env[65943]: INFO networking_nsxv3.common.synchronization [req-06eda1a3-0dd4-48ca-bc45-f44d9f8298e8 req-28d15e09-ca35-43bc-aa7e-d0c57c5fe78a tempest-ListImageFiltersTestJSON-1963006750 tempest-ListImageFiltersTestJSON-1963006750-project-member] Enqueued Resource ID: c00c3594-d682-43fb-9d53-d5100f161d24 with Priority: HIGHEST for action security_group_members [ 815.638120] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c00c3594-d682-43fb-9d53-d5100f161d24 with Priority: HIGHEST for action security_group_members [ 815.638120] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c00c3594-d682-43fb-9d53-d5100f161d24 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.638120] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.638286] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.638624] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.638624] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.639952] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.639952] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.639952] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.639952] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.639952] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c00c3594-d682-43fb-9d53-d5100f161d24',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.961453] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-651 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.961768] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.961768] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.962023] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.962274] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.962421] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.962528] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.962733] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.962873] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.963104] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 815.963217] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 815.963290] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 815.963386] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 815.963483] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 815.963579] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 815.963697] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 815.987043] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 815.987043] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 815.987043] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 815.987043] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.987278] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-75016f6f-fe6b-45fa-9119-3a2d06d18801 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.987386] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-75016f6f-fe6b-45fa-9119-3a2d06d18801" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.987502] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-75016f6f-fe6b-45fa-9119-3a2d06d18801" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.987821] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-75016f6f-fe6b-45fa-9119-3a2d06d18801" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.988012] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75016f6f-fe6b-45fa-9119-3a2d06d18801',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.143200] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.143365] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.143436] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.143658] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.143749] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.143941] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.144052] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.144114] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.144263] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.144337] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.144473] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c00c3594-d682-43fb-9d53-d5100f161d24 already deleted. [ 816.144537] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.490352] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.490615] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.490810] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.491163] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.491358] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.491585] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port 75016f6f-fe6b-45fa-9119-3a2d06d18801 not found, creating... [ 816.491915] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.492142] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.492316] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.492604] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.492778] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.493131] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.493344] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.493521] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.493744] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.494273] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.494273] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: 75016f6f-fe6b-45fa-9119-3a2d06d18801 is going to be created. [ 816.518979] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.519358] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.519494] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.519812] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.520172] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.520464] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-75016f6f-fe6b-45fa-9119-3a2d06d18801" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.859160] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b in Status: SUCCESS [ 816.859160] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.859160] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.859160] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.859160] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.859160] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.859160] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.861405] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.861405] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.861405] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.861405] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.030850] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf in Status: SUCCESS [ 817.030850] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.030850] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.030850] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.031232] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.031232] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.031232] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.031352] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.031383] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.031490] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cddfb2d8-8ac5-496b-aee4-ea09e6b59edf',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.247112] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e02be8c7-70b1-4488-b079-b1ebf20a733c in Status: SUCCESS [ 817.247412] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.248422] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 in Status: SUCCESS [ 817.248862] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.250226] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b in Status: SUCCESS [ 817.250459] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.252591] env[65943]: INFO networking_nsxv3.common.synchronization [req-06eda1a3-0dd4-48ca-bc45-f44d9f8298e8 req-dce58acb-9498-4488-aa2d-0db66b1a80e0 service nova] Enqueued Resource ID: c00c3594-d682-43fb-9d53-d5100f161d24 with Priority: HIGHEST for action security_group_rules [ 817.252807] env[65943]: INFO networking_nsxv3.common.synchronization [req-06eda1a3-0dd4-48ca-bc45-f44d9f8298e8 req-dce58acb-9498-4488-aa2d-0db66b1a80e0 service nova] Enqueued Resource ID: c00c3594-d682-43fb-9d53-d5100f161d24 with Priority: HIGHEST for action security_group_members [ 817.252997] env[65943]: INFO networking_nsxv3.common.synchronization [req-06eda1a3-0dd4-48ca-bc45-f44d9f8298e8 req-dce58acb-9498-4488-aa2d-0db66b1a80e0 service nova] Enqueued Resource ID: 75016f6f-fe6b-45fa-9119-3a2d06d18801 with Priority: HIGHEST for action port [ 817.254621] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c00c3594-d682-43fb-9d53-d5100f161d24 with Priority: HIGHEST for action security_group_rules [ 817.254808] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c00c3594-d682-43fb-9d53-d5100f161d24 with Priority: HIGHEST for action security_group_members [ 817.254961] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75016f6f-fe6b-45fa-9119-3a2d06d18801 with Priority: HIGHEST for action port [ 817.255459] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c00c3594-d682-43fb-9d53-d5100f161d24 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.255612] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.255678] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.256037] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.256152] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c00c3594-d682-43fb-9d53-d5100f161d24',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.257135] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c00c3594-d682-43fb-9d53-d5100f161d24 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.257242] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.257242] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.257409] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.257816] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.257816] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.257816] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.257816] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.258103] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.258103] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c00c3594-d682-43fb-9d53-d5100f161d24',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.258731] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-75016f6f-fe6b-45fa-9119-3a2d06d18801 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.258839] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75016f6f-fe6b-45fa-9119-3a2d06d18801" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.258886] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75016f6f-fe6b-45fa-9119-3a2d06d18801" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.259134] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75016f6f-fe6b-45fa-9119-3a2d06d18801" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.259189] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75016f6f-fe6b-45fa-9119-3a2d06d18801',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.272033] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 in Status: SUCCESS [ 817.272270] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.274541] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 in Status: SUCCESS [ 817.274619] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.365037] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.404052] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e in Status: SUCCESS [ 817.404241] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.534564] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cddfb2d8-8ac5-496b-aee4-ea09e6b59edf',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.760535] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c00c3594-d682-43fb-9d53-d5100f161d24 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.760687] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.762012] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 75016f6f-fe6b-45fa-9119-3a2d06d18801 with status ACTIVE [ 817.762210] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.762350] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.762411] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.762586] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.762689] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.762879] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.762997] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.763069] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.763293] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.763293] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.763827] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.763827] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.763827] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.763827] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.763827] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.764065] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 75016f6f-fe6b-45fa-9119-3a2d06d18801 is going to be updated. [ 817.765020] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c00c3594-d682-43fb-9d53-d5100f161d24',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.786639] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.786795] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.786867] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.787114] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.787254] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.787467] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75016f6f-fe6b-45fa-9119-3a2d06d18801" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.867039] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b: rpc.has_security_group_logging(os_id): False [ 817.889019] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.889019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.889019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.889019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.889019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.889019] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.889019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.889019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.889019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.889019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.889019] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b is going to be created. [ 817.981784] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.981784] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.981784] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.982213] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.982213] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.000148] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b in Status: IN_PROGRESS for 2s [ 818.037251] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cddfb2d8-8ac5-496b-aee4-ea09e6b59edf',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.201710] env[65943]: INFO networking_nsxv3.common.synchronization [req-298282cf-6c45-4d4a-9d71-2bc9226d6aae req-ccc5fdf5-13b9-4cb1-8f6c-9b0d6fe1aba2 tempest-ListImageFiltersTestJSON-1963006750 tempest-ListImageFiltersTestJSON-1963006750-project-member] Enqueued Resource ID: c00c3594-d682-43fb-9d53-d5100f161d24 with Priority: HIGHEST for action security_group_members [ 818.202313] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c00c3594-d682-43fb-9d53-d5100f161d24 with Priority: HIGHEST for action security_group_members [ 818.202634] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c00c3594-d682-43fb-9d53-d5100f161d24 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.203068] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.268102] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c00c3594-d682-43fb-9d53-d5100f161d24',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.542626] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.542854] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.542934] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.543189] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.543292] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.543415] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf is going to be updated. [ 818.567680] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-651 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.567897] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.568067] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.568334] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.568635] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.568737] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.568846] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.569065] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.569242] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.569454] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 818.569562] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 818.569664] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 818.569765] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 818.569864] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 818.570019] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 818.570102] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 818.575722] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.575863] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.575914] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.576114] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.576264] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.585349] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf in Status: IN_PROGRESS for 2s [ 818.590027] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 818.590332] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 818.590532] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 818.590790] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.591264] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-d8a60780-2193-4bda-a5e5-b88240902bba taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.591541] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-d8a60780-2193-4bda-a5e5-b88240902bba" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.591749] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-d8a60780-2193-4bda-a5e5-b88240902bba" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.592255] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-d8a60780-2193-4bda-a5e5-b88240902bba" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.592466] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8a60780-2193-4bda-a5e5-b88240902bba',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.772667] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.772868] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.772938] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.776034] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.776034] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.776034] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c00c3594-d682-43fb-9d53-d5100f161d24 is going to be created. [ 818.798247] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.798630] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.798630] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.798959] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.799233] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.819899] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c00c3594-d682-43fb-9d53-d5100f161d24 in Status: UNINITIALIZED for 2s [ 819.095860] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.096346] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.096346] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.096680] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.096995] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.097191] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port d8a60780-2193-4bda-a5e5-b88240902bba not found, creating... [ 819.097483] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.097696] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.097771] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.098017] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.098167] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.098468] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.098625] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.098735] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.099064] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.099242] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.099465] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: d8a60780-2193-4bda-a5e5-b88240902bba is going to be created. [ 819.159197] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.159468] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.159635] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.160237] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.160506] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.160855] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-d8a60780-2193-4bda-a5e5-b88240902bba" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.906198] env[65943]: INFO networking_nsxv3.common.synchronization [req-298282cf-6c45-4d4a-9d71-2bc9226d6aae req-d28c3f2d-caf4-4ba0-9f27-948752a77f7a service nova] Enqueued Resource ID: c00c3594-d682-43fb-9d53-d5100f161d24 with Priority: HIGHEST for action security_group_rules [ 819.906198] env[65943]: INFO networking_nsxv3.common.synchronization [req-298282cf-6c45-4d4a-9d71-2bc9226d6aae req-d28c3f2d-caf4-4ba0-9f27-948752a77f7a service nova] Enqueued Resource ID: c00c3594-d682-43fb-9d53-d5100f161d24 with Priority: HIGHEST for action security_group_members [ 819.906198] env[65943]: INFO networking_nsxv3.common.synchronization [req-298282cf-6c45-4d4a-9d71-2bc9226d6aae req-d28c3f2d-caf4-4ba0-9f27-948752a77f7a service nova] Enqueued Resource ID: d8a60780-2193-4bda-a5e5-b88240902bba with Priority: HIGHEST for action port [ 819.906198] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c00c3594-d682-43fb-9d53-d5100f161d24 with Priority: HIGHEST for action security_group_rules [ 819.906198] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c00c3594-d682-43fb-9d53-d5100f161d24 with Priority: HIGHEST for action security_group_members [ 819.906198] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8a60780-2193-4bda-a5e5-b88240902bba with Priority: HIGHEST for action port [ 819.907207] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c00c3594-d682-43fb-9d53-d5100f161d24 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.907606] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.908179] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c00c3594-d682-43fb-9d53-d5100f161d24 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.908419] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.908832] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8a60780-2193-4bda-a5e5-b88240902bba taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.909865] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8a60780-2193-4bda-a5e5-b88240902bba" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.909865] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8a60780-2193-4bda-a5e5-b88240902bba" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.909865] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8a60780-2193-4bda-a5e5-b88240902bba" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.910498] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8a60780-2193-4bda-a5e5-b88240902bba',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.016846] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b in Status: SUCCESS [ 820.017156] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.116130] env[65943]: INFO networking_nsxv3.common.synchronization [req-8e2beaf9-1f17-430b-81c3-de4fc54672be req-234fe089-5c25-4874-9de2-0e34f2757c20 tempest-ServersAdminTestJSON-910281195 tempest-ServersAdminTestJSON-910281195-project-member] Enqueued Resource ID: e02be8c7-70b1-4488-b079-b1ebf20a733c with Priority: HIGHEST for action security_group_members [ 820.116682] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e02be8c7-70b1-4488-b079-b1ebf20a733c with Priority: HIGHEST for action security_group_members [ 820.117021] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e02be8c7-70b1-4488-b079-b1ebf20a733c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.117152] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.117234] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.117690] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.117690] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.117690] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.117690] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.117915] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.117915] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.118369] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.412854] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d8a60780-2193-4bda-a5e5-b88240902bba with status ACTIVE [ 820.413159] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.413321] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.413357] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.413572] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.413664] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.413831] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.413936] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.413988] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.414167] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.414242] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.414421] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.414515] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.414567] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.414824] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.415283] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.415283] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d8a60780-2193-4bda-a5e5-b88240902bba is going to be updated. [ 820.440367] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.440367] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.440367] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.440621] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.440716] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.440834] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8a60780-2193-4bda-a5e5-b88240902bba" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.594985] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf in Status: SUCCESS [ 820.595228] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.595395] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.595617] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.595811] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.595924] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.596015] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.596198] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.596372] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.596372] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.596553] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.596605] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.596665] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.596803] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.597017] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.597105] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.597165] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.597306] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.597380] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.597460] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.597560] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cddfb2d8-8ac5-496b-aee4-ea09e6b59edf',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.620486] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.805065] env[65943]: INFO networking_nsxv3.common.synchronization [req-1edc5841-41bc-405a-b1e1-88a7bc5cee72 req-a151d737-8d81-4444-b7ed-1ae61ce67201 tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_members [ 820.805640] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_members [ 820.805946] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-69913569-f584-45f7-91a4-ec8af89769a9 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.806227] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.806311] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.806564] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.806727] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.806838] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.806944] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.807121] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.807209] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.807304] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.964900] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c00c3594-d682-43fb-9d53-d5100f161d24 in Status: SUCCESS [ 820.965134] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.965533] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.965792] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.965928] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.966051] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.966115] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.966263] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.966340] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.966419] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.966511] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c00c3594-d682-43fb-9d53-d5100f161d24',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.967799] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.968009] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.968382] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.968497] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.968561] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.968707] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.968783] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.968868] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c00c3594-d682-43fb-9d53-d5100f161d24',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.099937] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cddfb2d8-8ac5-496b-aee4-ea09e6b59edf: rpc.has_security_group_logging(os_id): False [ 821.118272] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.118637] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.118637] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.118720] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.122693] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.126623] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-892 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.126623] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-892" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.126747] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-892" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.127046] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-892" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.127329] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.127500] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.127613] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.127824] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.128025] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.128236] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 821.128308] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 821.128419] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 821.128530] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 821.128628] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 821.128712] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 821.128833] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 821.139549] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.139804] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.139931] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.139993] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.140183] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.140261] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.140459] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.140564] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.140620] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.141902] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.141902] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.141902] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.141902] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.141902] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.141902] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.141902] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.141902] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf is going to be updated. [ 821.149526] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 821.149526] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 821.149526] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 821.149526] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-892" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.149788] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-db4bc84d-eceb-4d58-84c3-02784f4db3a4 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.149788] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-db4bc84d-eceb-4d58-84c3-02784f4db3a4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.149918] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-db4bc84d-eceb-4d58-84c3-02784f4db3a4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.151031] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-db4bc84d-eceb-4d58-84c3-02784f4db3a4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.151031] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db4bc84d-eceb-4d58-84c3-02784f4db3a4',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.210919] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.210919] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.211825] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.211825] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.211825] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.227381] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf in Status: IN_PROGRESS for 2s [ 821.457909] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.458132] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.458182] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.458371] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.458456] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.458655] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.458746] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.458847] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.458967] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.459020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.459103] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69913569-f584-45f7-91a4-ec8af89769a9 already deleted. [ 821.459187] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.470942] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c00c3594-d682-43fb-9d53-d5100f161d24 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.471164] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.471343] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c00c3594-d682-43fb-9d53-d5100f161d24',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.624900] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.625146] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.625197] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.625386] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.625482] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.625584] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e02be8c7-70b1-4488-b079-b1ebf20a733c is going to be updated. [ 821.652829] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.653162] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.653335] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.653629] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.653811] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.654032] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port db4bc84d-eceb-4d58-84c3-02784f4db3a4 not found, creating... [ 821.654378] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.654590] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.654666] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.654993] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.655169] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.655511] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.655731] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.655906] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.656214] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.656383] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.656602] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: db4bc84d-eceb-4d58-84c3-02784f4db3a4 is going to be created. [ 821.659473] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.660014] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.660111] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.660369] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.660503] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.671860] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e02be8c7-70b1-4488-b079-b1ebf20a733c in Status: IN_PROGRESS for 2s [ 821.682906] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.683218] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.683279] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.683524] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.683747] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.684044] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-db4bc84d-eceb-4d58-84c3-02784f4db3a4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.975097] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c00c3594-d682-43fb-9d53-d5100f161d24',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.392934] env[65943]: INFO networking_nsxv3.common.synchronization [req-23b8d8f0-4b20-491b-a147-5b1cdf32e5ff req-cd72d579-8c2f-482c-9584-e2fb0afc2ed9 tempest-ListServersNegativeTestJSON-1591552957 tempest-ListServersNegativeTestJSON-1591552957-project-member] Enqueued Resource ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf with Priority: HIGHEST for action security_group_members [ 822.394089] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf with Priority: HIGHEST for action security_group_members [ 822.394089] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.394089] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.394089] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.394347] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.394422] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.394560] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.394622] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.394775] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.395068] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.395068] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cddfb2d8-8ac5-496b-aee4-ea09e6b59edf',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.464309] env[65943]: INFO networking_nsxv3.common.synchronization [req-1edc5841-41bc-405a-b1e1-88a7bc5cee72 req-a7fd6418-1667-4ab6-ba67-0cf67d7d4c7a service nova] Enqueued Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_rules [ 822.465688] env[65943]: INFO networking_nsxv3.common.synchronization [req-1edc5841-41bc-405a-b1e1-88a7bc5cee72 req-a7fd6418-1667-4ab6-ba67-0cf67d7d4c7a service nova] Enqueued Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_members [ 822.465688] env[65943]: INFO networking_nsxv3.common.synchronization [req-1edc5841-41bc-405a-b1e1-88a7bc5cee72 req-a7fd6418-1667-4ab6-ba67-0cf67d7d4c7a service nova] Enqueued Resource ID: db4bc84d-eceb-4d58-84c3-02784f4db3a4 with Priority: HIGHEST for action port [ 822.465688] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_rules [ 822.465688] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_members [ 822.465688] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db4bc84d-eceb-4d58-84c3-02784f4db3a4 with Priority: HIGHEST for action port [ 822.465688] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69913569-f584-45f7-91a4-ec8af89769a9 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.466216] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.466216] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.466216] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.466325] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.467961] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-69913569-f584-45f7-91a4-ec8af89769a9 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.467961] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.467961] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.467961] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.469780] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.469780] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.469780] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.469780] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.469780] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.469780] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.469780] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-db4bc84d-eceb-4d58-84c3-02784f4db3a4 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.469780] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db4bc84d-eceb-4d58-84c3-02784f4db3a4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.469780] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db4bc84d-eceb-4d58-84c3-02784f4db3a4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.469780] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db4bc84d-eceb-4d58-84c3-02784f4db3a4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.469780] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db4bc84d-eceb-4d58-84c3-02784f4db3a4',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.476309] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.476459] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.476531] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.476718] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.476810] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.476921] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c00c3594-d682-43fb-9d53-d5100f161d24 is going to be updated. [ 822.507839] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.508041] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.508134] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.508364] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.508505] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.520112] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c00c3594-d682-43fb-9d53-d5100f161d24 in Status: IN_PROGRESS for 2s [ 822.896970] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cddfb2d8-8ac5-496b-aee4-ea09e6b59edf',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.973058] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port db4bc84d-eceb-4d58-84c3-02784f4db3a4 with status ACTIVE [ 822.973058] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.973058] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.973058] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.973058] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.973058] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.973058] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.973058] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.973058] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.973058] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.973510] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.973510] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.973510] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.973510] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.973639] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.973639] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.973836] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: db4bc84d-eceb-4d58-84c3-02784f4db3a4 is going to be updated. [ 822.974972] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-69913569-f584-45f7-91a4-ec8af89769a9 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.975097] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.975280] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.997100] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.997304] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.997304] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.997488] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.997598] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.997746] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db4bc84d-eceb-4d58-84c3-02784f4db3a4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.242291] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf in Status: SUCCESS [ 823.242556] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.242805] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.243103] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.243210] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cddfb2d8-8ac5-496b-aee4-ea09e6b59edf',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.399928] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cddfb2d8-8ac5-496b-aee4-ea09e6b59edf',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.478130] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.571926] env[65943]: INFO networking_nsxv3.common.synchronization [req-ddf26c5e-f2fd-43a0-996b-78b894160bd1 req-30d80e0c-ece6-4c53-b0f1-23e1165e7966 tempest-ServerRescueNegativeTestJSON-734649129 tempest-ServerRescueNegativeTestJSON-734649129-project-member] Enqueued Resource ID: 2d899613-c950-496a-aec6-9bbbbbf253b5 with Priority: HIGHEST for action security_group_members [ 823.573688] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d899613-c950-496a-aec6-9bbbbbf253b5 with Priority: HIGHEST for action security_group_members [ 823.575864] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d899613-c950-496a-aec6-9bbbbbf253b5 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.576029] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.576106] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.576367] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.576538] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.576640] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.576704] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.577011] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.577011] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.577262] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d899613-c950-496a-aec6-9bbbbbf253b5',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.681855] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e02be8c7-70b1-4488-b079-b1ebf20a733c in Status: SUCCESS [ 823.682703] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.746035] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.746197] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.902191] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.902354] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.902438] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.902635] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.902724] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.902824] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf is going to be updated. [ 823.933106] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-982 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.933106] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-982" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.933106] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-982" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.933481] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-982" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.934416] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.934416] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.934416] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.934665] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.934828] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.935135] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 823.935300] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 823.935454] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 823.935611] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 823.935770] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 823.935922] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 823.936276] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 823.940131] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.940302] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.940407] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.940646] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.940830] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.953108] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf in Status: IN_PROGRESS for 2s [ 823.983985] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 823.984470] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.048 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 823.984707] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 823.984984] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-982" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.985474] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-93177fd3-938a-499a-9710-016b8d72a207 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.985742] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-93177fd3-938a-499a-9710-016b8d72a207" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.985914] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-93177fd3-938a-499a-9710-016b8d72a207" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.986450] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-93177fd3-938a-499a-9710-016b8d72a207" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.986593] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93177fd3-938a-499a-9710-016b8d72a207',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.987889] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.988081] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.988156] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.988641] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.988641] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.988641] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69913569-f584-45f7-91a4-ec8af89769a9 is going to be created. [ 824.017478] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.017645] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.017695] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.018351] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.018351] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.031248] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69913569-f584-45f7-91a4-ec8af89769a9 in Status: UNINITIALIZED for 2s [ 824.079575] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.079771] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.079866] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.080110] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.080193] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.080397] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.080502] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.080567] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.080701] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.080777] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.080864] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d899613-c950-496a-aec6-9bbbbbf253b5 already deleted. [ 824.080947] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.494678] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.494678] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.495207] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.495378] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.495864] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.496106] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port 93177fd3-938a-499a-9710-016b8d72a207 not found, creating... [ 824.496474] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.496775] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.497041] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.497311] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.497458] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.497783] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.498031] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.498159] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.498354] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.498489] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.498629] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: 93177fd3-938a-499a-9710-016b8d72a207 is going to be created. [ 824.523163] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.523455] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.523560] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.523903] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.524186] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.524424] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-93177fd3-938a-499a-9710-016b8d72a207" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.536364] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c00c3594-d682-43fb-9d53-d5100f161d24 in Status: SUCCESS [ 824.536616] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.536754] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.537052] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.537281] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.537494] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.537494] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.537717] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.537909] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.538038] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c00c3594-d682-43fb-9d53-d5100f161d24',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.040386] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c00c3594-d682-43fb-9d53-d5100f161d24',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.215258] env[65943]: INFO networking_nsxv3.common.synchronization [req-ddf26c5e-f2fd-43a0-996b-78b894160bd1 req-3ac52bbf-3cbd-4cb6-8d44-b2dbfffe72c4 service nova] Enqueued Resource ID: 2d899613-c950-496a-aec6-9bbbbbf253b5 with Priority: HIGHEST for action security_group_rules [ 825.215807] env[65943]: INFO networking_nsxv3.common.synchronization [req-ddf26c5e-f2fd-43a0-996b-78b894160bd1 req-3ac52bbf-3cbd-4cb6-8d44-b2dbfffe72c4 service nova] Enqueued Resource ID: 2d899613-c950-496a-aec6-9bbbbbf253b5 with Priority: HIGHEST for action security_group_members [ 825.216550] env[65943]: INFO networking_nsxv3.common.synchronization [req-ddf26c5e-f2fd-43a0-996b-78b894160bd1 req-3ac52bbf-3cbd-4cb6-8d44-b2dbfffe72c4 service nova] Enqueued Resource ID: 93177fd3-938a-499a-9710-016b8d72a207 with Priority: HIGHEST for action port [ 825.216550] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d899613-c950-496a-aec6-9bbbbbf253b5 with Priority: HIGHEST for action security_group_rules [ 825.216670] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d899613-c950-496a-aec6-9bbbbbf253b5 with Priority: HIGHEST for action security_group_members [ 825.217303] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93177fd3-938a-499a-9710-016b8d72a207 with Priority: HIGHEST for action port [ 825.217303] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d899613-c950-496a-aec6-9bbbbbf253b5 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.217303] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.217303] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.217624] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.217624] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d899613-c950-496a-aec6-9bbbbbf253b5',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.219152] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d899613-c950-496a-aec6-9bbbbbf253b5 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.219152] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.219152] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.219152] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.219711] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.219711] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.219711] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.219711] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.219873] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.219910] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d899613-c950-496a-aec6-9bbbbbf253b5',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.221153] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-93177fd3-938a-499a-9710-016b8d72a207 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.221153] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93177fd3-938a-499a-9710-016b8d72a207" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.221153] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93177fd3-938a-499a-9710-016b8d72a207" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.221153] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93177fd3-938a-499a-9710-016b8d72a207" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.221153] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93177fd3-938a-499a-9710-016b8d72a207',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.542315] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c00c3594-d682-43fb-9d53-d5100f161d24',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.724468] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d899613-c950-496a-aec6-9bbbbbf253b5 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.724468] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.724674] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d899613-c950-496a-aec6-9bbbbbf253b5',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.725595] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 93177fd3-938a-499a-9710-016b8d72a207 with status ACTIVE [ 825.726340] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.726340] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.726340] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.726340] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.726340] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.726609] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.726609] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.726609] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.727097] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.727097] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.727791] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.727970] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.728426] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.729231] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.729231] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.729231] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 93177fd3-938a-499a-9710-016b8d72a207 is going to be updated. [ 825.751833] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.751987] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.752072] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.752287] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.752426] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.752581] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93177fd3-938a-499a-9710-016b8d72a207" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.962720] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf in Status: SUCCESS [ 825.962941] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.963155] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.963490] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.963582] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.963676] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.963830] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.963901] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.963983] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.964085] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.964178] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cddfb2d8-8ac5-496b-aee4-ea09e6b59edf',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.042194] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69913569-f584-45f7-91a4-ec8af89769a9 in Status: SUCCESS [ 826.042397] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.042563] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.042775] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.042968] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.043093] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.043157] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.043300] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.043380] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.043463] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.043555] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.044636] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.044737] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.044814] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.044985] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.045078] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.045167] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c00c3594-d682-43fb-9d53-d5100f161d24 is going to be updated. [ 826.073589] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.073721] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.073769] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.074389] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.074515] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.083909] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c00c3594-d682-43fb-9d53-d5100f161d24 in Status: IN_PROGRESS for 2s [ 826.197418] env[65943]: INFO networking_nsxv3.common.synchronization [req-d2a798e4-b98d-4b8e-a2e6-94ec6a852de8 req-4e6e740e-32a8-4814-974b-4ccca5040a18 tempest-ServerRescueNegativeTestJSON-734649129 tempest-ServerRescueNegativeTestJSON-734649129-project-member] Enqueued Resource ID: 2d899613-c950-496a-aec6-9bbbbbf253b5 with Priority: HIGHEST for action security_group_members [ 826.198690] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d899613-c950-496a-aec6-9bbbbbf253b5 with Priority: HIGHEST for action security_group_members [ 826.199043] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d899613-c950-496a-aec6-9bbbbbf253b5 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.199151] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.231146] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d899613-c950-496a-aec6-9bbbbbf253b5',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.466661] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.466796] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.466937] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.467231] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.467537] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.467598] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.467823] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.467823] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.470020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.470020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.470020] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.470020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.470020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.470020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.470020] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.470020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.470020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.470020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.470020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.470020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.470020] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cddfb2d8-8ac5-496b-aee4-ea09e6b59edf',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.547550] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-69913569-f584-45f7-91a4-ec8af89769a9 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.547891] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.547990] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.548379] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.548681] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.548872] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.549016] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.549488] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.549638] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.549844] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.550073] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-69913569-f584-45f7-91a4-ec8af89769a9 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.550220] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.550339] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.550585] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.550861] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.550999] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.551089] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.551263] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.551344] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.551457] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.551556] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.558502] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-982 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.558696] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-982" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.558854] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-982" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.559133] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-982" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.559409] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.559758] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.559897] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.560126] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.560289] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.560507] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 826.560618] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 826.560734] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 826.560840] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 826.560958] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 826.561080] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 826.561221] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 826.581592] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 826.581780] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 826.581925] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 826.583358] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-982" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.583358] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-d1d82927-bf33-44d3-aef6-5c658e943028 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.583358] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-d1d82927-bf33-44d3-aef6-5c658e943028" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.583358] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-d1d82927-bf33-44d3-aef6-5c658e943028" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.583358] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-d1d82927-bf33-44d3-aef6-5c658e943028" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.583670] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1d82927-bf33-44d3-aef6-5c658e943028',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.736192] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.736192] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.736192] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.736192] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.736192] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.736192] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d899613-c950-496a-aec6-9bbbbbf253b5 is going to be created. [ 826.771074] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.771282] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.771327] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.771562] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.771744] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.782439] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d899613-c950-496a-aec6-9bbbbbf253b5 in Status: UNINITIALIZED for 2s [ 826.976447] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cddfb2d8-8ac5-496b-aee4-ea09e6b59edf: rpc.has_security_group_logging(os_id): False [ 826.999714] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.000083] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.000083] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.000331] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.000331] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.000515] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.000641] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.000764] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.000862] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.000973] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.001146] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.001252] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.001307] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.001466] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.001540] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.001755] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.001853] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.001972] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.002088] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.002157] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.002250] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf is going to be updated. [ 827.054648] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69913569-f584-45f7-91a4-ec8af89769a9: rpc.has_security_group_logging(os_id): False [ 827.085458] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.085721] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.085776] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.087806] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.087806] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.087806] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port d1d82927-bf33-44d3-aef6-5c658e943028 not found, creating... [ 827.087806] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.087806] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.087806] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.088377] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.088377] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.088377] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.088581] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.088651] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.089046] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.089224] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.089698] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: d1d82927-bf33-44d3-aef6-5c658e943028 is going to be created. [ 827.091340] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.091408] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.091445] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.091628] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.092057] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.092057] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.092057] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.092207] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.092252] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.092335] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.092570] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.092714] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.092793] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.093012] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.094791] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.094892] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.094955] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.094992] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.095200] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.095286] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.095381] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69913569-f584-45f7-91a4-ec8af89769a9 is going to be created. [ 827.098021] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.098179] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.098227] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.098382] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.098520] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.121610] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf in Status: IN_PROGRESS for 2s [ 827.124950] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.125269] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.125469] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.125698] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.126146] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.126399] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-d1d82927-bf33-44d3-aef6-5c658e943028" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.194170] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.194170] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.194170] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.194170] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.194170] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.328266] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69913569-f584-45f7-91a4-ec8af89769a9 in Status: IN_PROGRESS for 2s [ 827.880239] env[65943]: INFO networking_nsxv3.common.synchronization [req-d2a798e4-b98d-4b8e-a2e6-94ec6a852de8 req-f0aa5d2b-9742-486d-9104-3dff017e5117 service nova] Enqueued Resource ID: 2d899613-c950-496a-aec6-9bbbbbf253b5 with Priority: HIGHEST for action security_group_rules [ 827.880855] env[65943]: INFO networking_nsxv3.common.synchronization [req-d2a798e4-b98d-4b8e-a2e6-94ec6a852de8 req-f0aa5d2b-9742-486d-9104-3dff017e5117 service nova] Enqueued Resource ID: 2d899613-c950-496a-aec6-9bbbbbf253b5 with Priority: HIGHEST for action security_group_members [ 827.881786] env[65943]: INFO networking_nsxv3.common.synchronization [req-d2a798e4-b98d-4b8e-a2e6-94ec6a852de8 req-f0aa5d2b-9742-486d-9104-3dff017e5117 service nova] Enqueued Resource ID: d1d82927-bf33-44d3-aef6-5c658e943028 with Priority: HIGHEST for action port [ 827.882644] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d899613-c950-496a-aec6-9bbbbbf253b5 with Priority: HIGHEST for action security_group_rules [ 827.882876] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d899613-c950-496a-aec6-9bbbbbf253b5 with Priority: HIGHEST for action security_group_members [ 827.883051] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1d82927-bf33-44d3-aef6-5c658e943028 with Priority: HIGHEST for action port [ 827.883481] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d899613-c950-496a-aec6-9bbbbbf253b5 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.883631] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.883955] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d899613-c950-496a-aec6-9bbbbbf253b5 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.884101] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.884371] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1d82927-bf33-44d3-aef6-5c658e943028 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.885090] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1d82927-bf33-44d3-aef6-5c658e943028" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.885090] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1d82927-bf33-44d3-aef6-5c658e943028" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.885090] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1d82927-bf33-44d3-aef6-5c658e943028" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.885090] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1d82927-bf33-44d3-aef6-5c658e943028',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.094116] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c00c3594-d682-43fb-9d53-d5100f161d24 in Status: SUCCESS [ 828.094251] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.094450] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.094755] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.094955] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.095082] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.095356] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.095356] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.095500] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.095500] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.095606] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c00c3594-d682-43fb-9d53-d5100f161d24 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.095704] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.095756] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.095899] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.096045] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.096126] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.096186] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.096322] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.096396] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.096482] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.096598] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c00c3594-d682-43fb-9d53-d5100f161d24',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.389916] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d1d82927-bf33-44d3-aef6-5c658e943028 with status ACTIVE [ 828.389916] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.389916] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.389916] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.389916] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.389916] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.389916] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.390231] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.390231] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.390231] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.390542] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.390542] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.390679] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.390679] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.390825] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.390897] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.390981] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d1d82927-bf33-44d3-aef6-5c658e943028 is going to be updated. [ 828.411717] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.411860] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.411929] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.412167] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.412310] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.412473] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1d82927-bf33-44d3-aef6-5c658e943028" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.598392] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c00c3594-d682-43fb-9d53-d5100f161d24: rpc.has_security_group_logging(os_id): False [ 828.619607] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.619726] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.619786] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.620137] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.620137] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.620302] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.620403] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.620465] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.620617] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.620740] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.620858] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.620950] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.621022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.621206] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.621300] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.621493] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.621585] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.621638] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.621775] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.621848] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.621931] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c00c3594-d682-43fb-9d53-d5100f161d24 is going to be created. [ 828.693115] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.693357] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.693357] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.693663] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.693941] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.709015] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c00c3594-d682-43fb-9d53-d5100f161d24 in Status: IN_PROGRESS for 2s [ 828.804577] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d899613-c950-496a-aec6-9bbbbbf253b5 in Status: SUCCESS [ 828.804577] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.804577] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.804577] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.804577] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.804860] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.804860] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.804988] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.804988] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.805088] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.805172] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d899613-c950-496a-aec6-9bbbbbf253b5',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.806083] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.806256] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.806430] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.806532] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.806595] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.806734] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.806809] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.806898] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d899613-c950-496a-aec6-9bbbbbf253b5',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.951024] env[65943]: INFO networking_nsxv3.common.synchronization [req-a4170406-fbc2-4eb8-929f-a51aae2fb686 req-c2abc1a6-50d3-4ed6-b4d1-4e64a21e435a tempest-ServerActionsTestOtherA-92071881 tempest-ServerActionsTestOtherA-92071881-project-member] Enqueued Resource ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 with Priority: HIGHEST for action security_group_members [ 828.951807] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 with Priority: HIGHEST for action security_group_members [ 828.952170] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-89dec01a-fac4-47c6-9d76-7e922dba6ec4 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.952297] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.952363] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.952689] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.952893] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.953018] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.953075] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.953578] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.953578] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.953578] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89dec01a-fac4-47c6-9d76-7e922dba6ec4',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.138319] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf in Status: SUCCESS [ 829.138558] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.310684] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d899613-c950-496a-aec6-9bbbbbf253b5',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.313540] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d899613-c950-496a-aec6-9bbbbbf253b5 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.313540] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.341087] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69913569-f584-45f7-91a4-ec8af89769a9 in Status: SUCCESS [ 829.341746] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.343494] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-863 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.343743] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-863" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.343877] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-863" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.344201] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-863" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.344502] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.344736] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.344971] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.345162] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.345295] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.346766] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 829.346766] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 829.346766] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 829.346766] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 829.346766] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 829.346766] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 829.347075] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 829.366281] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 829.366445] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 829.366560] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 829.366722] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-863" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.367066] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-b9d3a466-3437-4937-86aa-7c977382711f taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.367258] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-b9d3a466-3437-4937-86aa-7c977382711f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.367341] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-b9d3a466-3437-4937-86aa-7c977382711f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.367647] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-b9d3a466-3437-4937-86aa-7c977382711f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.367780] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9d3a466-3437-4937-86aa-7c977382711f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.455428] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.455632] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.455681] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.455866] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.455960] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.456184] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.456314] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.456382] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.456550] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.456662] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.456782] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 already deleted. [ 829.456888] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.815418] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d899613-c950-496a-aec6-9bbbbbf253b5',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.870380] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.870662] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.870808] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.871151] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.871342] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.871519] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port b9d3a466-3437-4937-86aa-7c977382711f not found, creating... [ 829.871994] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.871994] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.872194] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.872482] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.872574] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.872853] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.873069] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.873200] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.873442] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.873585] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.873738] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: b9d3a466-3437-4937-86aa-7c977382711f is going to be created. [ 829.895661] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.895977] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.896250] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.896745] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.897236] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.897565] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-b9d3a466-3437-4937-86aa-7c977382711f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.318852] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.318852] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.318852] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.318852] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.318852] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.318852] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d899613-c950-496a-aec6-9bbbbbf253b5 is going to be updated. [ 830.348681] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.348681] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.348849] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.349078] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.349323] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.361490] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d899613-c950-496a-aec6-9bbbbbf253b5 in Status: IN_PROGRESS for 2s [ 830.646998] env[65943]: INFO networking_nsxv3.common.synchronization [req-a4170406-fbc2-4eb8-929f-a51aae2fb686 req-da1adf4c-7416-4873-b738-d76fc0c9312c service nova] Enqueued Resource ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 with Priority: HIGHEST for action security_group_rules [ 830.647254] env[65943]: INFO networking_nsxv3.common.synchronization [req-a4170406-fbc2-4eb8-929f-a51aae2fb686 req-da1adf4c-7416-4873-b738-d76fc0c9312c service nova] Enqueued Resource ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 with Priority: HIGHEST for action security_group_members [ 830.647404] env[65943]: INFO networking_nsxv3.common.synchronization [req-a4170406-fbc2-4eb8-929f-a51aae2fb686 req-da1adf4c-7416-4873-b738-d76fc0c9312c service nova] Enqueued Resource ID: b9d3a466-3437-4937-86aa-7c977382711f with Priority: HIGHEST for action port [ 830.647986] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 with Priority: HIGHEST for action security_group_rules [ 830.648431] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 with Priority: HIGHEST for action security_group_members [ 830.648604] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9d3a466-3437-4937-86aa-7c977382711f with Priority: HIGHEST for action port [ 830.648932] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-89dec01a-fac4-47c6-9d76-7e922dba6ec4 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.649122] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.650542] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.651126] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.651295] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('89dec01a-fac4-47c6-9d76-7e922dba6ec4',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.652987] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-89dec01a-fac4-47c6-9d76-7e922dba6ec4 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.653815] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.653901] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.654133] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.654295] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.654405] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.654468] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.654624] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.654702] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.654819] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89dec01a-fac4-47c6-9d76-7e922dba6ec4',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.657898] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9d3a466-3437-4937-86aa-7c977382711f taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.658550] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9d3a466-3437-4937-86aa-7c977382711f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.658550] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9d3a466-3437-4937-86aa-7c977382711f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.658876] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9d3a466-3437-4937-86aa-7c977382711f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.658876] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9d3a466-3437-4937-86aa-7c977382711f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.720682] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c00c3594-d682-43fb-9d53-d5100f161d24 in Status: SUCCESS [ 830.720682] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.720682] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.720930] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.720978] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c00c3594-d682-43fb-9d53-d5100f161d24',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.153768] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-89dec01a-fac4-47c6-9d76-7e922dba6ec4 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.153915] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.161401] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('89dec01a-fac4-47c6-9d76-7e922dba6ec4',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.162981] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b9d3a466-3437-4937-86aa-7c977382711f with status ACTIVE [ 831.164931] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.164931] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.164931] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.164931] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.164931] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.164931] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.164931] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.164931] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.164931] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.164931] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.164931] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.164931] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.164931] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.164931] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.164931] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.164931] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b9d3a466-3437-4937-86aa-7c977382711f is going to be updated. [ 831.187924] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.187924] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.188223] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.188223] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.188362] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.188530] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9d3a466-3437-4937-86aa-7c977382711f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.224202] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c00c3594-d682-43fb-9d53-d5100f161d24 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.224369] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.224462] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.224646] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.224856] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.225035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.225035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.225194] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.225310] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.225378] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.225437] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c00c3594-d682-43fb-9d53-d5100f161d24',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.664447] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('89dec01a-fac4-47c6-9d76-7e922dba6ec4',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.731717] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c00c3594-d682-43fb-9d53-d5100f161d24 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.731993] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.732083] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.732396] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.732640] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.732782] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.732878] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.733136] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.733265] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.733510] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.733645] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c00c3594-d682-43fb-9d53-d5100f161d24 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.733724] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.733800] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.734013] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.734233] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.734483] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.734483] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.734678] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.734783] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.734893] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.735046] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c00c3594-d682-43fb-9d53-d5100f161d24',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.748902] env[65943]: INFO networking_nsxv3.common.synchronization [req-4c603454-6971-40be-b7ce-5582874fe5bf req-10e32429-b2cd-4590-8f67-201b9a155d2d tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_members [ 831.749115] env[65943]: INFO networking_nsxv3.common.synchronization [req-4c603454-6971-40be-b7ce-5582874fe5bf req-10e32429-b2cd-4590-8f67-201b9a155d2d tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: dcaf51d1-3d78-4731-8697-ec542f23f503 with Priority: HIGHEST for action security_group_members [ 831.749646] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_members [ 831.749789] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcaf51d1-3d78-4731-8697-ec542f23f503 with Priority: HIGHEST for action security_group_members [ 831.750559] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-69913569-f584-45f7-91a4-ec8af89769a9 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.750559] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.750559] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.750695] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.751174] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.751174] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.751310] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.751502] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.751614] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.751814] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.752741] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcaf51d1-3d78-4731-8697-ec542f23f503 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.752853] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.753202] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.753202] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.753304] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.753372] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.753445] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.753594] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.753642] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.753729] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dcaf51d1-3d78-4731-8697-ec542f23f503',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.808604] env[65943]: INFO networking_nsxv3.common.synchronization [req-4c603454-6971-40be-b7ce-5582874fe5bf req-10e32429-b2cd-4590-8f67-201b9a155d2d tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_rules [ 831.808860] env[65943]: INFO networking_nsxv3.common.synchronization [req-4c603454-6971-40be-b7ce-5582874fe5bf req-10e32429-b2cd-4590-8f67-201b9a155d2d tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_members [ 831.809048] env[65943]: INFO networking_nsxv3.common.synchronization [req-4c603454-6971-40be-b7ce-5582874fe5bf req-10e32429-b2cd-4590-8f67-201b9a155d2d tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: dcaf51d1-3d78-4731-8697-ec542f23f503 with Priority: HIGHEST for action security_group_rules [ 831.809225] env[65943]: INFO networking_nsxv3.common.synchronization [req-4c603454-6971-40be-b7ce-5582874fe5bf req-10e32429-b2cd-4590-8f67-201b9a155d2d tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: dcaf51d1-3d78-4731-8697-ec542f23f503 with Priority: HIGHEST for action security_group_members [ 831.809365] env[65943]: INFO networking_nsxv3.common.synchronization [req-4c603454-6971-40be-b7ce-5582874fe5bf req-10e32429-b2cd-4590-8f67-201b9a155d2d tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: db4bc84d-eceb-4d58-84c3-02784f4db3a4 with Priority: HIGHEST for action port [ 831.809962] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_rules [ 831.810137] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcaf51d1-3d78-4731-8697-ec542f23f503 with Priority: HIGHEST for action security_group_rules [ 831.810255] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db4bc84d-eceb-4d58-84c3-02784f4db3a4 with Priority: HIGHEST for action port [ 831.810318] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_members [ 831.810416] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcaf51d1-3d78-4731-8697-ec542f23f503 with Priority: HIGHEST for action security_group_members [ 831.810700] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69913569-f584-45f7-91a4-ec8af89769a9 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.810818] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.810881] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.811112] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.811194] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.812405] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dcaf51d1-3d78-4731-8697-ec542f23f503 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.812518] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.812583] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.812813] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.812909] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dcaf51d1-3d78-4731-8697-ec542f23f503',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.813723] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-db4bc84d-eceb-4d58-84c3-02784f4db3a4 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.813831] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db4bc84d-eceb-4d58-84c3-02784f4db3a4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.813911] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db4bc84d-eceb-4d58-84c3-02784f4db3a4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.814087] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db4bc84d-eceb-4d58-84c3-02784f4db3a4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.814229] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db4bc84d-eceb-4d58-84c3-02784f4db3a4',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.815127] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-69913569-f584-45f7-91a4-ec8af89769a9 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.815127] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.815221] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcaf51d1-3d78-4731-8697-ec542f23f503 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.815262] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.169043] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.169043] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.169043] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.169043] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.169043] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.169043] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 is going to be created. [ 832.198986] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.199329] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.199428] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.199651] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.199822] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.212622] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 in Status: UNINITIALIZED for 2s [ 832.231396] env[65943]: INFO networking_nsxv3.common.synchronization [req-8fa8be5f-ff5e-40ea-8ff9-10b91c63281e req-46e87cef-0e56-41e0-acb8-d26f169c75ee tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: dcaf51d1-3d78-4731-8697-ec542f23f503 with Priority: HIGHEST for action security_group_members [ 832.231473] env[65943]: INFO networking_nsxv3.common.synchronization [req-8fa8be5f-ff5e-40ea-8ff9-10b91c63281e req-46e87cef-0e56-41e0-acb8-d26f169c75ee tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_members [ 832.231760] env[65943]: INFO networking_nsxv3.common.synchronization [req-8fa8be5f-ff5e-40ea-8ff9-10b91c63281e req-46e87cef-0e56-41e0-acb8-d26f169c75ee tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: 2a4b01a6-74af-4232-8012-76435e07acca with Priority: HIGHEST for action security_group_members [ 832.233168] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcaf51d1-3d78-4731-8697-ec542f23f503 with Priority: HIGHEST for action security_group_members [ 832.233404] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_members [ 832.233878] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a4b01a6-74af-4232-8012-76435e07acca with Priority: HIGHEST for action security_group_members [ 832.234979] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcaf51d1-3d78-4731-8697-ec542f23f503 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.234979] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.234979] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-69913569-f584-45f7-91a4-ec8af89769a9 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.234979] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.235664] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a4b01a6-74af-4232-8012-76435e07acca taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.235664] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a4b01a6-74af-4232-8012-76435e07acca" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.235664] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a4b01a6-74af-4232-8012-76435e07acca" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.235664] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a4b01a6-74af-4232-8012-76435e07acca" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.236112] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.236235] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.236311] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.236509] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.236634] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.236817] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a4b01a6-74af-4232-8012-76435e07acca',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.239241] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c00c3594-d682-43fb-9d53-d5100f161d24: rpc.has_security_group_logging(os_id): False [ 832.261021] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.261021] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dcaf51d1-3d78-4731-8697-ec542f23f503',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.265089] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.265311] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.265311] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.266028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.266028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.266028] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.266028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.266028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.266637] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.266637] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.266637] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.266637] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.266637] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.268303] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.268303] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.268303] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.268303] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.268303] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.268303] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.268303] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.268303] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c00c3594-d682-43fb-9d53-d5100f161d24 is going to be updated. [ 832.317934] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-69913569-f584-45f7-91a4-ec8af89769a9 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.317934] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.317934] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcaf51d1-3d78-4731-8697-ec542f23f503 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.317934] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.318233] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port db4bc84d-eceb-4d58-84c3-02784f4db3a4 with status ACTIVE [ 832.318233] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.318334] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.318975] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.318975] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.318975] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.318975] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.318975] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.318975] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.319326] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.319326] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.320269] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.320269] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.320269] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.320269] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.320269] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.320269] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: db4bc84d-eceb-4d58-84c3-02784f4db3a4 is going to be updated. [ 832.323493] env[65943]: INFO networking_nsxv3.common.synchronization [req-8fa8be5f-ff5e-40ea-8ff9-10b91c63281e req-46e87cef-0e56-41e0-acb8-d26f169c75ee tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: 2a4b01a6-74af-4232-8012-76435e07acca with Priority: HIGHEST for action security_group_rules [ 832.323493] env[65943]: INFO networking_nsxv3.common.synchronization [req-8fa8be5f-ff5e-40ea-8ff9-10b91c63281e req-46e87cef-0e56-41e0-acb8-d26f169c75ee tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: 2a4b01a6-74af-4232-8012-76435e07acca with Priority: HIGHEST for action security_group_members [ 832.325058] env[65943]: INFO networking_nsxv3.common.synchronization [req-8fa8be5f-ff5e-40ea-8ff9-10b91c63281e req-46e87cef-0e56-41e0-acb8-d26f169c75ee tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_rules [ 832.325058] env[65943]: INFO networking_nsxv3.common.synchronization [req-8fa8be5f-ff5e-40ea-8ff9-10b91c63281e req-46e87cef-0e56-41e0-acb8-d26f169c75ee tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_members [ 832.325058] env[65943]: INFO networking_nsxv3.common.synchronization [req-8fa8be5f-ff5e-40ea-8ff9-10b91c63281e req-46e87cef-0e56-41e0-acb8-d26f169c75ee tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: dcaf51d1-3d78-4731-8697-ec542f23f503 with Priority: HIGHEST for action security_group_rules [ 832.325058] env[65943]: INFO networking_nsxv3.common.synchronization [req-8fa8be5f-ff5e-40ea-8ff9-10b91c63281e req-46e87cef-0e56-41e0-acb8-d26f169c75ee tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: dcaf51d1-3d78-4731-8697-ec542f23f503 with Priority: HIGHEST for action security_group_members [ 832.325058] env[65943]: INFO networking_nsxv3.common.synchronization [req-8fa8be5f-ff5e-40ea-8ff9-10b91c63281e req-46e87cef-0e56-41e0-acb8-d26f169c75ee tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: db4bc84d-eceb-4d58-84c3-02784f4db3a4 with Priority: HIGHEST for action port [ 832.325058] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a4b01a6-74af-4232-8012-76435e07acca with Priority: HIGHEST for action security_group_rules [ 832.325323] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_rules [ 832.325323] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcaf51d1-3d78-4731-8697-ec542f23f503 with Priority: HIGHEST for action security_group_members [ 832.325390] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db4bc84d-eceb-4d58-84c3-02784f4db3a4 with Priority: HIGHEST for action port [ 832.325533] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcaf51d1-3d78-4731-8697-ec542f23f503 with Priority: HIGHEST for action security_group_rules [ 832.325533] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a4b01a6-74af-4232-8012-76435e07acca with Priority: HIGHEST for action security_group_members [ 832.325611] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_members [ 832.326521] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a4b01a6-74af-4232-8012-76435e07acca taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.326618] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a4b01a6-74af-4232-8012-76435e07acca" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.327469] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a4b01a6-74af-4232-8012-76435e07acca" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.327469] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a4b01a6-74af-4232-8012-76435e07acca" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.327996] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a4b01a6-74af-4232-8012-76435e07acca',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.329487] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69913569-f584-45f7-91a4-ec8af89769a9 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.329630] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.330017] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcaf51d1-3d78-4731-8697-ec542f23f503 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.330159] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.330514] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-db4bc84d-eceb-4d58-84c3-02784f4db3a4 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.330569] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db4bc84d-eceb-4d58-84c3-02784f4db3a4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.330955] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dcaf51d1-3d78-4731-8697-ec542f23f503 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.330955] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.331278] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a4b01a6-74af-4232-8012-76435e07acca taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.331671] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a4b01a6-74af-4232-8012-76435e07acca" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.331751] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-69913569-f584-45f7-91a4-ec8af89769a9 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.331918] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.353453] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.353985] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.353985] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.353985] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.354212] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.354307] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db4bc84d-eceb-4d58-84c3-02784f4db3a4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.354752] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db4bc84d-eceb-4d58-84c3-02784f4db3a4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.354752] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db4bc84d-eceb-4d58-84c3-02784f4db3a4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.354752] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db4bc84d-eceb-4d58-84c3-02784f4db3a4',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.361913] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.362126] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.362126] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.362462] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.362642] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.378373] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d899613-c950-496a-aec6-9bbbbbf253b5 in Status: SUCCESS [ 832.378373] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.378495] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.378682] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.379340] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.379510] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.379510] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.379717] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.379824] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.379931] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d899613-c950-496a-aec6-9bbbbbf253b5',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.381632] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c00c3594-d682-43fb-9d53-d5100f161d24 in Status: IN_PROGRESS for 2s [ 832.741130] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a4b01a6-74af-4232-8012-76435e07acca',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.764306] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dcaf51d1-3d78-4731-8697-ec542f23f503',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.765660] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.834257] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a4b01a6-74af-4232-8012-76435e07acca taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.834418] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a4b01a6-74af-4232-8012-76435e07acca" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.857041] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port db4bc84d-eceb-4d58-84c3-02784f4db3a4 with status ACTIVE [ 832.857300] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.857443] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.857588] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.857772] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.857880] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.858086] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.858221] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.858285] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.858481] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.858563] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.858757] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.859095] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.859164] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.859357] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.859493] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.859528] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: db4bc84d-eceb-4d58-84c3-02784f4db3a4 is going to be updated. [ 832.883775] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d899613-c950-496a-aec6-9bbbbbf253b5',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.888015] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.888015] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.888015] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.888015] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.888657] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.888657] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db4bc84d-eceb-4d58-84c3-02784f4db3a4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.243388] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a4b01a6-74af-4232-8012-76435e07acca',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.266674] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.266843] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.267468] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.267468] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.267468] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.267468] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcaf51d1-3d78-4731-8697-ec542f23f503 is going to be created. [ 833.269477] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.269652] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.269760] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.269991] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.270215] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.270385] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69913569-f584-45f7-91a4-ec8af89769a9 is going to be updated. [ 833.299821] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.300248] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.300414] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.300669] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.300804] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.302767] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.302906] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.302966] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.303258] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.303258] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.313055] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcaf51d1-3d78-4731-8697-ec542f23f503 in Status: UNINITIALIZED for 2s [ 833.313807] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69913569-f584-45f7-91a4-ec8af89769a9 in Status: IN_PROGRESS for 2s [ 833.387543] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d899613-c950-496a-aec6-9bbbbbf253b5',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.749249] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.749249] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.749249] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.749249] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.749852] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.749852] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a4b01a6-74af-4232-8012-76435e07acca is going to be created. [ 833.776830] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.777077] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.777137] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.777454] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.777627] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.789613] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a4b01a6-74af-4232-8012-76435e07acca in Status: UNINITIALIZED for 2s [ 833.890601] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.890774] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.890821] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.891060] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.891205] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.891275] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d899613-c950-496a-aec6-9bbbbbf253b5 is going to be updated. [ 833.937833] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.937833] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.937833] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.937833] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.937833] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.949927] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d899613-c950-496a-aec6-9bbbbbf253b5 in Status: IN_PROGRESS for 2s [ 834.224092] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 in Status: SUCCESS [ 834.228022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.228022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.228022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.228022] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.228022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.228022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.228022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.228022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.228022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.228022] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('89dec01a-fac4-47c6-9d76-7e922dba6ec4',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.397147] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c00c3594-d682-43fb-9d53-d5100f161d24 in Status: SUCCESS [ 834.397336] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.733402] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-89dec01a-fac4-47c6-9d76-7e922dba6ec4 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.735094] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.735265] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.736957] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.737271] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.737431] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.737496] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.737710] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.737813] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.737954] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.738114] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-89dec01a-fac4-47c6-9d76-7e922dba6ec4 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.738219] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.738284] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.738447] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.738595] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.738689] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.738750] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.738895] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.738972] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.740254] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.740254] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('89dec01a-fac4-47c6-9d76-7e922dba6ec4',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.242618] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 89dec01a-fac4-47c6-9d76-7e922dba6ec4: rpc.has_security_group_logging(os_id): False [ 835.291547] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.291547] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.291547] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.292025] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.292025] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.292025] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.292239] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.292239] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.292347] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.292513] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.292590] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.292687] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.292745] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.292936] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.293034] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.293178] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.293270] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.293328] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.293595] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.293595] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.293595] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 is going to be created. [ 835.327293] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69913569-f584-45f7-91a4-ec8af89769a9 in Status: SUCCESS [ 835.327293] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.327599] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.327708] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.327902] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.328030] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.328099] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.328866] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.328866] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.328866] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.330251] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcaf51d1-3d78-4731-8697-ec542f23f503 in Status: SUCCESS [ 835.330918] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.330918] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.330918] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.330918] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.331209] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.331209] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.331282] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.331343] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.331431] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dcaf51d1-3d78-4731-8697-ec542f23f503',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.376094] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.376304] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.376546] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.376683] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.376850] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.392882] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 in Status: IN_PROGRESS for 2s [ 835.802950] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a4b01a6-74af-4232-8012-76435e07acca in Status: SUCCESS [ 835.804504] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a4b01a6-74af-4232-8012-76435e07acca" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.804702] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a4b01a6-74af-4232-8012-76435e07acca" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.804935] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a4b01a6-74af-4232-8012-76435e07acca" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.805150] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.805277] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.805342] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.805506] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.806401] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.806401] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a4b01a6-74af-4232-8012-76435e07acca',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.833626] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.834567] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dcaf51d1-3d78-4731-8697-ec542f23f503',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.960619] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d899613-c950-496a-aec6-9bbbbbf253b5 in Status: SUCCESS [ 835.961344] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.963507] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.963507] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.963507] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.963507] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.963507] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.963507] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.963507] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.963507] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.963507] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d899613-c950-496a-aec6-9bbbbbf253b5 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.963507] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.963507] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.963507] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.963507] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.963507] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.963507] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.963507] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.963507] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.964210] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.964210] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d899613-c950-496a-aec6-9bbbbbf253b5',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.134803] env[65943]: INFO networking_nsxv3.common.synchronization [req-fcefc59b-a54a-42df-b997-177b469b483e req-9475647d-acf0-468a-8386-080e30dab0a6 tempest-ServerDiskConfigTestJSON-397438939 tempest-ServerDiskConfigTestJSON-397438939-project-member] Enqueued Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_members [ 836.135693] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_members [ 836.136102] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b127ff-135f-4cd2-9456-bc11d98737ce taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.136271] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.136362] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.136594] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.137038] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.139036] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.139036] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.139036] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.139036] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.139036] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.311210] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a4b01a6-74af-4232-8012-76435e07acca',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.336634] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.337708] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dcaf51d1-3d78-4731-8697-ec542f23f503',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.468666] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d899613-c950-496a-aec6-9bbbbbf253b5: rpc.has_security_group_logging(os_id): False [ 836.491146] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.491146] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.491146] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.491146] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.491538] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.491538] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.491538] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.491669] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.491836] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.491926] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.492213] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.492337] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.492415] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.492627] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.492714] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.492943] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.494368] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.494368] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.494368] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.494368] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.494368] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d899613-c950-496a-aec6-9bbbbbf253b5 is going to be created. [ 836.559774] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.559914] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.559914] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.560132] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.561215] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.575047] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d899613-c950-496a-aec6-9bbbbbf253b5 in Status: IN_PROGRESS for 2s [ 836.640813] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.640982] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.641087] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.641469] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.668897] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.669366] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.669468] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.669578] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.671066] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.671066] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.671066] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9b127ff-135f-4cd2-9456-bc11d98737ce is going to be updated. [ 836.687840] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-327 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.688286] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-327" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.688286] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-327" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.688607] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-327" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.688911] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.689230] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.689348] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.690029] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.690029] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.690177] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 836.690228] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 836.690353] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 836.690470] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 836.691068] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 836.691068] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 836.691068] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 836.701155] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.701473] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.701473] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.701758] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.701916] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.727883] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 836.728097] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 836.728097] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 836.728273] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-327" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.729067] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-556d4634-d26c-4d3c-8b32-535c75d06b58 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.729067] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-556d4634-d26c-4d3c-8b32-535c75d06b58" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.729067] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-556d4634-d26c-4d3c-8b32-535c75d06b58" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.729700] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-556d4634-d26c-4d3c-8b32-535c75d06b58" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.729700] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('556d4634-d26c-4d3c-8b32-535c75d06b58',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.731547] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b127ff-135f-4cd2-9456-bc11d98737ce in Status: IN_PROGRESS for 2s [ 836.817716] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a4b01a6-74af-4232-8012-76435e07acca',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.843561] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.843561] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.843561] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.843561] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.843561] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.843561] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69913569-f584-45f7-91a4-ec8af89769a9 is going to be updated. [ 836.846289] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.846635] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.846801] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.847235] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.847995] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.847995] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcaf51d1-3d78-4731-8697-ec542f23f503 is going to be updated. [ 836.881914] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.881914] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.881914] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.882309] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.882309] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.885367] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.885591] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.885591] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.885813] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.885996] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.900289] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69913569-f584-45f7-91a4-ec8af89769a9 in Status: IN_PROGRESS for 2s [ 836.901305] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcaf51d1-3d78-4731-8697-ec542f23f503 in Status: IN_PROGRESS for 2s [ 837.233639] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.233953] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.234134] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.234483] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.234735] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.234953] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port 556d4634-d26c-4d3c-8b32-535c75d06b58 not found, creating... [ 837.235411] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.235645] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.235843] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.236210] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.236449] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.236945] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.237204] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.237394] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.237925] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.237925] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.238170] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: 556d4634-d26c-4d3c-8b32-535c75d06b58 is going to be created. [ 837.274203] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.275868] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.275868] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.275868] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.275868] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.276330] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-556d4634-d26c-4d3c-8b32-535c75d06b58" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.321381] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.321381] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.321381] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.321381] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.321381] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.321381] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a4b01a6-74af-4232-8012-76435e07acca is going to be updated. [ 837.379811] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.380070] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.380070] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.380310] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.380476] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.394505] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a4b01a6-74af-4232-8012-76435e07acca in Status: IN_PROGRESS for 2s [ 837.428511] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 in Status: SUCCESS [ 837.428732] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.083360] env[65943]: INFO networking_nsxv3.common.synchronization [req-fcefc59b-a54a-42df-b997-177b469b483e req-e349dba9-9987-43c7-8a05-62a2854de518 service nova] Enqueued Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_rules [ 838.083521] env[65943]: INFO networking_nsxv3.common.synchronization [req-fcefc59b-a54a-42df-b997-177b469b483e req-e349dba9-9987-43c7-8a05-62a2854de518 service nova] Enqueued Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_members [ 838.083733] env[65943]: INFO networking_nsxv3.common.synchronization [req-fcefc59b-a54a-42df-b997-177b469b483e req-e349dba9-9987-43c7-8a05-62a2854de518 service nova] Enqueued Resource ID: 556d4634-d26c-4d3c-8b32-535c75d06b58 with Priority: HIGHEST for action port [ 838.084295] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_rules [ 838.084450] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_members [ 838.084548] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 556d4634-d26c-4d3c-8b32-535c75d06b58 with Priority: HIGHEST for action port [ 838.084844] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9b127ff-135f-4cd2-9456-bc11d98737ce taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.085085] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.085222] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.085474] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.085603] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.091145] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b127ff-135f-4cd2-9456-bc11d98737ce taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.091145] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.091145] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-556d4634-d26c-4d3c-8b32-535c75d06b58 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.091145] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-556d4634-d26c-4d3c-8b32-535c75d06b58" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.091145] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-556d4634-d26c-4d3c-8b32-535c75d06b58" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.091145] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-556d4634-d26c-4d3c-8b32-535c75d06b58" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.091145] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('556d4634-d26c-4d3c-8b32-535c75d06b58',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.587340] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d899613-c950-496a-aec6-9bbbbbf253b5 in Status: SUCCESS [ 838.587736] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.587736] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.588274] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.588404] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d899613-c950-496a-aec6-9bbbbbf253b5',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.591884] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b127ff-135f-4cd2-9456-bc11d98737ce taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.592139] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.593348] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 556d4634-d26c-4d3c-8b32-535c75d06b58 with status ACTIVE [ 838.593561] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.593690] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.593745] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.593942] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.594083] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.594215] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.594314] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.594375] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.594609] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.594809] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.594858] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.595087] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.595087] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.595205] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.595240] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.596050] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 556d4634-d26c-4d3c-8b32-535c75d06b58 is going to be updated. [ 838.621029] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.621249] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.621340] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.621480] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.621614] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.621771] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-556d4634-d26c-4d3c-8b32-535c75d06b58" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.744889] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b127ff-135f-4cd2-9456-bc11d98737ce in Status: SUCCESS [ 838.744889] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9b127ff-135f-4cd2-9456-bc11d98737ce deletion is rescheduled due to dependency. [ 838.744889] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.745162] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.745447] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.746272] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.746272] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.746272] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.746272] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.746272] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.747530] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.914038] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69913569-f584-45f7-91a4-ec8af89769a9 in Status: SUCCESS [ 838.914308] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.915221] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcaf51d1-3d78-4731-8697-ec542f23f503 in Status: SUCCESS [ 838.915453] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.915599] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.915901] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.917070] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.917070] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.917070] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.917070] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.917070] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.917070] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.917984] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.918265] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.918381] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.918504] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.918582] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.918725] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.918801] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.918885] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dcaf51d1-3d78-4731-8697-ec542f23f503',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.093023] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d899613-c950-496a-aec6-9bbbbbf253b5 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.093023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.093023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.093023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.093023] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.093023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.093023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.093023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.093023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.093023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.093023] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d899613-c950-496a-aec6-9bbbbbf253b5',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.249836] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.357711] env[65943]: INFO networking_nsxv3.common.synchronization [None req-532c6006-5550-4efa-ba88-db108a30df45 None None] Enqueued Resource ID: 74e93748-768c-46b2-957c-fc5c764b142e with Priority: HIGHEST for action port [ 839.359667] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74e93748-768c-46b2-957c-fc5c764b142e with Priority: HIGHEST for action port [ 839.361516] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-74e93748-768c-46b2-957c-fc5c764b142e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.361516] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74e93748-768c-46b2-957c-fc5c764b142e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.361516] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74e93748-768c-46b2-957c-fc5c764b142e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.362662] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74e93748-768c-46b2-957c-fc5c764b142e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.364320] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74e93748-768c-46b2-957c-fc5c764b142e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.408149] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a4b01a6-74af-4232-8012-76435e07acca in Status: SUCCESS [ 839.409040] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a4b01a6-74af-4232-8012-76435e07acca" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.409040] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a4b01a6-74af-4232-8012-76435e07acca" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.409040] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a4b01a6-74af-4232-8012-76435e07acca" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.409226] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.409226] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.409318] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.409433] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.409517] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.409603] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a4b01a6-74af-4232-8012-76435e07acca" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.409692] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2a4b01a6-74af-4232-8012-76435e07acca',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.421213] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.424094] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dcaf51d1-3d78-4731-8697-ec542f23f503',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.599973] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d899613-c950-496a-aec6-9bbbbbf253b5 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.599973] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.599973] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.599973] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.599973] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.599973] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.599973] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.599973] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.599973] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.599973] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.599973] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d899613-c950-496a-aec6-9bbbbbf253b5 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.599973] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.599973] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.599973] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.599973] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.599973] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.600837] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.600837] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.600837] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.600837] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.600837] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d899613-c950-496a-aec6-9bbbbbf253b5',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.752681] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.867882] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 74e93748-768c-46b2-957c-fc5c764b142e [ 839.867882] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.867882] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.867882] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.868178] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.868244] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.868416] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:74e93748-768c-46b2-957c-fc5c764b142e already deleted. [ 839.868513] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74e93748-768c-46b2-957c-fc5c764b142e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.911818] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2a4b01a6-74af-4232-8012-76435e07acca',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.924349] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.930061] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dcaf51d1-3d78-4731-8697-ec542f23f503',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.106489] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d899613-c950-496a-aec6-9bbbbbf253b5: rpc.has_security_group_logging(os_id): False [ 840.125109] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.125476] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.125666] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.128033] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.128033] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.128033] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.128033] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.128033] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.128033] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.128033] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.128033] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.128033] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.128033] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.128033] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.128033] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.128033] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.128033] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.128716] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.128716] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.128716] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.128716] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d899613-c950-496a-aec6-9bbbbbf253b5 is going to be updated. [ 840.196840] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.196840] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.196840] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.196840] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.196840] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.215222] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d899613-c950-496a-aec6-9bbbbbf253b5 in Status: IN_PROGRESS for 2s [ 840.255647] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.256479] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.256479] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.256479] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.256479] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.256479] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9b127ff-135f-4cd2-9456-bc11d98737ce is going to be updated. [ 840.310175] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.310175] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.310175] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.310373] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.310814] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.327278] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b127ff-135f-4cd2-9456-bc11d98737ce in Status: IN_PROGRESS for 2s [ 840.415895] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2a4b01a6-74af-4232-8012-76435e07acca: rpc.has_security_group_logging(os_id): False [ 840.428051] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.428354] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.428551] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.428846] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.429068] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.429264] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69913569-f584-45f7-91a4-ec8af89769a9 is going to be updated. [ 840.430695] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.430945] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.431148] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.431543] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.432575] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.432575] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcaf51d1-3d78-4731-8697-ec542f23f503 is going to be updated. [ 840.447876] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.447876] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.448147] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.448225] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.448326] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.448857] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.448857] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.448857] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.448857] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.449118] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.449118] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a4b01a6-74af-4232-8012-76435e07acca is going to be created. [ 840.486545] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.486861] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.486861] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.487135] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.488028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.489494] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.489638] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.489924] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.489994] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.490170] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.504231] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcaf51d1-3d78-4731-8697-ec542f23f503 in Status: IN_PROGRESS for 2s [ 840.508365] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69913569-f584-45f7-91a4-ec8af89769a9 in Status: IN_PROGRESS for 2s [ 840.549266] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.549501] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.549501] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.549691] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.549887] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.567329] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a4b01a6-74af-4232-8012-76435e07acca in Status: IN_PROGRESS for 2s [ 842.232582] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d899613-c950-496a-aec6-9bbbbbf253b5 in Status: SUCCESS [ 842.233041] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.340267] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b127ff-135f-4cd2-9456-bc11d98737ce in Status: SUCCESS [ 842.340504] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.340694] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.340943] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.341153] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.341286] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.341351] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.341607] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.341705] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.341705] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.341837] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.526265] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcaf51d1-3d78-4731-8697-ec542f23f503 in Status: SUCCESS [ 842.526490] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.526731] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.526916] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.527185] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.527313] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.527379] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.527553] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.527640] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.527731] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.527884] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dcaf51d1-3d78-4731-8697-ec542f23f503',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.530574] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69913569-f584-45f7-91a4-ec8af89769a9 in Status: SUCCESS [ 842.530869] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.531125] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.531411] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.531683] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.531863] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.531972] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.532212] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.532344] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.532496] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dcaf51d1-3d78-4731-8697-ec542f23f503',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.533982] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.534249] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.534599] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.534920] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.535095] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.535242] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.535387] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.535544] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.535725] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.537411] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.537659] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.537912] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.538176] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.538176] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.538304] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.538415] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.538495] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.585399] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a4b01a6-74af-4232-8012-76435e07acca in Status: SUCCESS [ 842.585866] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a4b01a6-74af-4232-8012-76435e07acca" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.845524] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b127ff-135f-4cd2-9456-bc11d98737ce taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.845784] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.846775] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.847320] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.847868] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.848081] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.848236] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.848497] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.848713] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.848853] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.849083] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b127ff-135f-4cd2-9456-bc11d98737ce taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.849193] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.849266] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.849435] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.849953] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.850117] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.850196] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.850408] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.850524] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.850753] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.851148] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.037661] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dcaf51d1-3d78-4731-8697-ec542f23f503',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.038782] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dcaf51d1-3d78-4731-8697-ec542f23f503',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.041493] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.357408] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9b127ff-135f-4cd2-9456-bc11d98737ce: rpc.has_security_group_logging(os_id): False [ 843.378492] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.378572] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.378572] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.378798] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.378886] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.379139] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.379240] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.379298] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.379447] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.379524] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.379698] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.379787] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.379866] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.380015] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.380101] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.380321] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.380430] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.380494] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.380590] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.380658] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.380736] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9b127ff-135f-4cd2-9456-bc11d98737ce is going to be updated. [ 843.476022] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.476260] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.476424] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.476690] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.476840] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.492078] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9b127ff-135f-4cd2-9456-bc11d98737ce in Status: IN_PROGRESS for 2s [ 843.541641] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dcaf51d1-3d78-4731-8697-ec542f23f503: rpc.has_security_group_logging(os_id): False [ 843.543439] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dcaf51d1-3d78-4731-8697-ec542f23f503',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.544650] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-69913569-f584-45f7-91a4-ec8af89769a9 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.544776] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.546448] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.549123] env[65943]: INFO networking_nsxv3.common.synchronization [None req-ee63f05d-fb76-495c-a165-a751352cbdf3 None None] Enqueued Resource ID: 8c3a7f9f-ac78-42c4-ac6f-47cbf8fbe024 with Priority: HIGHEST for action port [ 843.549979] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c3a7f9f-ac78-42c4-ac6f-47cbf8fbe024 with Priority: HIGHEST for action port [ 843.550497] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c3a7f9f-ac78-42c4-ac6f-47cbf8fbe024 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.551648] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c3a7f9f-ac78-42c4-ac6f-47cbf8fbe024" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.551648] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c3a7f9f-ac78-42c4-ac6f-47cbf8fbe024" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.551648] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c3a7f9f-ac78-42c4-ac6f-47cbf8fbe024" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.551648] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c3a7f9f-ac78-42c4-ac6f-47cbf8fbe024',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.569228] env[65943]: INFO networking_nsxv3.common.synchronization [req-8352b2ff-5fa6-47be-8e00-8fbdc382edbc req-d2dd4167-1d33-4f33-9969-9afc4e50a236 tempest-DeleteServersTestJSON-1404918926 tempest-DeleteServersTestJSON-1404918926-project-member] Enqueued Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_members [ 843.569228] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_members [ 843.571337] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.571792] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.571892] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.572178] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.573090] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.573499] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.573499] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.574082] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.574229] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.574292] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.584571] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.584571] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.584571] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.584571] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.584571] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.584571] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.584571] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.584571] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.584571] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.584571] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.584571] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dcaf51d1-3d78-4731-8697-ec542f23f503 is going to be created. [ 843.656293] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.656293] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.656293] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.656293] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.656293] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.669327] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dcaf51d1-3d78-4731-8697-ec542f23f503 in Status: IN_PROGRESS for 2s [ 843.836342] env[65943]: INFO networking_nsxv3.common.synchronization [None req-93ddf0b8-b856-4346-99f1-b00b104225eb None None] Enqueued Resource ID: e95a85c1-570a-43b5-ab64-5ab831702e91 with Priority: HIGHEST for action port [ 843.837520] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e95a85c1-570a-43b5-ab64-5ab831702e91 with Priority: HIGHEST for action port [ 843.838173] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-e95a85c1-570a-43b5-ab64-5ab831702e91 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.838173] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e95a85c1-570a-43b5-ab64-5ab831702e91" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.838173] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e95a85c1-570a-43b5-ab64-5ab831702e91" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.838620] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e95a85c1-570a-43b5-ab64-5ab831702e91" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.838709] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e95a85c1-570a-43b5-ab64-5ab831702e91',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.048332] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.048332] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.048332] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.048332] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.048332] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.048332] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcaf51d1-3d78-4731-8697-ec542f23f503 is going to be updated. [ 844.051426] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.051581] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.051637] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.051848] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.051902] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.052014] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69913569-f584-45f7-91a4-ec8af89769a9 is going to be updated. [ 844.057029] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8c3a7f9f-ac78-42c4-ac6f-47cbf8fbe024 [ 844.057029] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.057271] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.057271] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.057477] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.057573] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.057667] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8c3a7f9f-ac78-42c4-ac6f-47cbf8fbe024 already deleted. [ 844.057747] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c3a7f9f-ac78-42c4-ac6f-47cbf8fbe024" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.080919] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.080919] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.080919] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.081138] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.081138] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.081268] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.081394] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.081448] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.082033] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.082033] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.082033] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 already deleted. [ 844.082033] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.087690] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-749 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.087883] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-749" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.087946] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-749" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.088297] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-749" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.088585] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.088739] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.088962] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.089105] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.089269] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.089537] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 844.089596] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 844.089706] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 844.089847] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 844.090073] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 844.090688] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 844.090688] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 844.133111] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 844.133333] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.043 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 844.133474] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 844.133672] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-749" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.134037] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-41ce6773-7b0d-4118-96f5-c8b89f69ed4f taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.134229] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-41ce6773-7b0d-4118-96f5-c8b89f69ed4f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.134372] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-41ce6773-7b0d-4118-96f5-c8b89f69ed4f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.134720] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-41ce6773-7b0d-4118-96f5-c8b89f69ed4f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.134862] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41ce6773-7b0d-4118-96f5-c8b89f69ed4f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.139452] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.139725] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.139725] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.140037] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.140316] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.143071] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.143071] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.143071] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.143071] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.143071] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.156303] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69913569-f584-45f7-91a4-ec8af89769a9 in Status: IN_PROGRESS for 2s [ 844.157114] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcaf51d1-3d78-4731-8697-ec542f23f503 in Status: IN_PROGRESS for 2s [ 844.216046] env[65943]: INFO networking_nsxv3.common.synchronization [req-d3030283-c39a-43d0-a745-ca0093cf933c req-366163cf-8997-4a7c-be11-26dcfd91792b tempest-ListServerFiltersTestJSON-237143396 tempest-ListServerFiltersTestJSON-237143396-project-member] Enqueued Resource ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e with Priority: HIGHEST for action security_group_members [ 844.216691] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e with Priority: HIGHEST for action security_group_members [ 844.217668] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8fad12-41c9-413e-91de-8c1ff3cf914e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.217817] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.217817] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.218073] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.218268] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.218380] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.218446] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.218601] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.218686] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.218785] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d8fad12-41c9-413e-91de-8c1ff3cf914e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.340748] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e95a85c1-570a-43b5-ab64-5ab831702e91 [ 844.340939] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.341088] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.341749] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.341749] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.341749] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.341749] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e95a85c1-570a-43b5-ab64-5ab831702e91 already deleted. [ 844.341749] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e95a85c1-570a-43b5-ab64-5ab831702e91" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.639759] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.640179] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.640391] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.640809] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.641064] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.641333] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port 41ce6773-7b0d-4118-96f5-c8b89f69ed4f not found, creating... [ 844.641759] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.642441] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.642441] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.642441] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.642606] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.643030] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.643746] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.643746] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.643949] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.644052] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.644273] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: 41ce6773-7b0d-4118-96f5-c8b89f69ed4f is going to be created. [ 844.704241] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.704241] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.704241] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.704241] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.704241] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.704241] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-41ce6773-7b0d-4118-96f5-c8b89f69ed4f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.721265] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d8fad12-41c9-413e-91de-8c1ff3cf914e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.224029] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d8fad12-41c9-413e-91de-8c1ff3cf914e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.419520] env[65943]: INFO networking_nsxv3.common.synchronization [req-8352b2ff-5fa6-47be-8e00-8fbdc382edbc req-73148a82-3395-485e-b8d0-72aa48c05297 service nova] Enqueued Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_rules [ 845.420145] env[65943]: INFO networking_nsxv3.common.synchronization [req-8352b2ff-5fa6-47be-8e00-8fbdc382edbc req-73148a82-3395-485e-b8d0-72aa48c05297 service nova] Enqueued Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_members [ 845.420145] env[65943]: INFO networking_nsxv3.common.synchronization [req-8352b2ff-5fa6-47be-8e00-8fbdc382edbc req-73148a82-3395-485e-b8d0-72aa48c05297 service nova] Enqueued Resource ID: 41ce6773-7b0d-4118-96f5-c8b89f69ed4f with Priority: HIGHEST for action port [ 845.422516] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_rules [ 845.422863] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_members [ 845.422863] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41ce6773-7b0d-4118-96f5-c8b89f69ed4f with Priority: HIGHEST for action port [ 845.423052] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.423218] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.423290] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.423522] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.423599] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.424556] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.424689] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.424760] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.424971] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.425166] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.425266] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.425328] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.425475] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.427205] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.427205] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.427205] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-41ce6773-7b0d-4118-96f5-c8b89f69ed4f taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.427205] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41ce6773-7b0d-4118-96f5-c8b89f69ed4f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.427205] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41ce6773-7b0d-4118-96f5-c8b89f69ed4f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.428445] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41ce6773-7b0d-4118-96f5-c8b89f69ed4f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.428569] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41ce6773-7b0d-4118-96f5-c8b89f69ed4f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.504881] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9b127ff-135f-4cd2-9456-bc11d98737ce in Status: SUCCESS [ 845.505285] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.696846] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dcaf51d1-3d78-4731-8697-ec542f23f503 in Status: SUCCESS [ 845.697171] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.697408] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.697599] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.697599] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dcaf51d1-3d78-4731-8697-ec542f23f503',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.726110] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.726272] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.726338] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.728226] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.728226] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.728226] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e is going to be updated. [ 845.765822] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.765822] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.765822] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.765822] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.766258] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.776123] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e in Status: IN_PROGRESS for 2s [ 845.931655] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.931792] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.932010] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.933094] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 41ce6773-7b0d-4118-96f5-c8b89f69ed4f with status ACTIVE [ 845.933290] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.933408] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.933477] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.934530] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.934530] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.934530] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.934530] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.934530] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.934530] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.934530] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.934852] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.934852] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.934852] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.934852] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.934998] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.935402] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 41ce6773-7b0d-4118-96f5-c8b89f69ed4f is going to be updated. [ 845.959485] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.959485] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.959485] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.959485] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.959485] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.959485] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41ce6773-7b0d-4118-96f5-c8b89f69ed4f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.168404] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69913569-f584-45f7-91a4-ec8af89769a9 in Status: SUCCESS [ 846.168663] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.168843] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.169074] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.169340] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.169420] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.169458] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.169594] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.169673] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.169760] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.169918] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-69913569-f584-45f7-91a4-ec8af89769a9 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.170019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.170080] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.170226] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.170435] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.170566] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.170629] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.170776] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.170899] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.170937] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.171151] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.172822] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcaf51d1-3d78-4731-8697-ec542f23f503 in Status: SUCCESS [ 846.173075] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.200357] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcaf51d1-3d78-4731-8697-ec542f23f503 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.200531] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.200586] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.200776] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.200938] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.201048] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.201124] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.201276] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.201361] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.201439] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.201525] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dcaf51d1-3d78-4731-8697-ec542f23f503',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.438552] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.533264] env[65943]: INFO networking_nsxv3.common.synchronization [None req-c5caf122-353b-4c1c-a6f8-c19a35dd7e2c tempest-MigrationsAdminTest-607423609 tempest-MigrationsAdminTest-607423609-project-member] Enqueued Resource ID: b453bc38-acb8-4f5d-b31a-196a31002153 with Priority: HIGHEST for action security_group_rules [ 846.533849] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b453bc38-acb8-4f5d-b31a-196a31002153 with Priority: HIGHEST for action security_group_rules [ 846.533849] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b453bc38-acb8-4f5d-b31a-196a31002153 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.534022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b453bc38-acb8-4f5d-b31a-196a31002153" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.534615] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b453bc38-acb8-4f5d-b31a-196a31002153" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.534615] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b453bc38-acb8-4f5d-b31a-196a31002153" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.534615] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b453bc38-acb8-4f5d-b31a-196a31002153',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.675832] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69913569-f584-45f7-91a4-ec8af89769a9: rpc.has_security_group_logging(os_id): False [ 846.701088] env[65943]: INFO networking_nsxv3.common.synchronization [None req-009cafd9-fb7c-4562-b74b-ea8511d9f566 tempest-MigrationsAdminTest-607423609 tempest-MigrationsAdminTest-607423609-project-member] Enqueued Resource ID: b453bc38-acb8-4f5d-b31a-196a31002153 with Priority: HIGHEST for action security_group_rules [ 846.701378] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b453bc38-acb8-4f5d-b31a-196a31002153 with Priority: HIGHEST for action security_group_rules [ 846.701546] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b453bc38-acb8-4f5d-b31a-196a31002153 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.701663] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b453bc38-acb8-4f5d-b31a-196a31002153" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.705193] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dcaf51d1-3d78-4731-8697-ec542f23f503',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.707847] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.707993] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.708073] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.708287] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.708392] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.708627] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.708728] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.708803] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.708999] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.709062] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.709217] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.709354] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.709397] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.709556] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.709631] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.709827] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.709920] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.709980] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.710171] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.710249] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.710339] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69913569-f584-45f7-91a4-ec8af89769a9 is going to be updated. [ 846.789718] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.789718] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.789718] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.789920] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.790071] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.837443] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69913569-f584-45f7-91a4-ec8af89769a9 in Status: IN_PROGRESS for 2s [ 846.944014] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.944014] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.944014] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.944014] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.944014] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.944014] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 is going to be created. [ 846.971437] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.971437] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.971437] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.971437] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.971437] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.980811] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: UNINITIALIZED for 2s [ 847.056633] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.056633] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.056633] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.056633] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.056633] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.056633] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b453bc38-acb8-4f5d-b31a-196a31002153 already deleted. [ 847.056633] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b453bc38-acb8-4f5d-b31a-196a31002153" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.056633] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b453bc38-acb8-4f5d-b31a-196a31002153" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.056633] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b453bc38-acb8-4f5d-b31a-196a31002153" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.056633] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b453bc38-acb8-4f5d-b31a-196a31002153',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.207192] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dcaf51d1-3d78-4731-8697-ec542f23f503: rpc.has_security_group_logging(os_id): False [ 847.226459] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.226650] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.226795] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.226880] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.227035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.227265] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.227379] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.227430] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.227582] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.227659] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.227744] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dcaf51d1-3d78-4731-8697-ec542f23f503 is going to be updated. [ 847.289063] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.289254] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.289307] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.289526] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.289670] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.303252] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dcaf51d1-3d78-4731-8697-ec542f23f503 in Status: IN_PROGRESS for 2s [ 847.577861] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.577861] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.577861] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.578180] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.578180] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.578180] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b453bc38-acb8-4f5d-b31a-196a31002153 already deleted. [ 847.578335] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b453bc38-acb8-4f5d-b31a-196a31002153" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.787032] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e in Status: SUCCESS [ 847.787372] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.853670] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69913569-f584-45f7-91a4-ec8af89769a9 in Status: SUCCESS [ 848.853977] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.854198] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.854423] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.854536] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.994438] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: SUCCESS [ 848.994509] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.994931] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.994931] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.995124] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.995917] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.995917] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.995917] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.995917] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.995917] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.995917] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.318430] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dcaf51d1-3d78-4731-8697-ec542f23f503 in Status: SUCCESS [ 849.318665] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.357784] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-69913569-f584-45f7-91a4-ec8af89769a9 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.357996] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.357996] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.358400] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.358612] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.358721] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.358786] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.358985] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.359092] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.359241] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.359337] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.499530] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.499753] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.499866] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.500133] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.500377] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.500514] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.500985] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.500985] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.500985] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.501166] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.501280] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.501455] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.501535] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.501722] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.501935] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.502368] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.502680] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.502819] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.502819] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.502970] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.503115] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.579232] env[65943]: INFO networking_nsxv3.common.synchronization [req-a2619985-f8a4-4ebc-b457-c64da57112a3 req-d2198fee-6929-4c26-8592-6cec39de804c tempest-ServersNegativeTestMultiTenantJSON-1688087976 tempest-ServersNegativeTestMultiTenantJSON-1688087976-project-member] Enqueued Resource ID: 2b7d77ea-cc30-4d0e-9a44-829eda93848d with Priority: HIGHEST for action security_group_members [ 849.580560] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b7d77ea-cc30-4d0e-9a44-829eda93848d with Priority: HIGHEST for action security_group_members [ 849.580677] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b7d77ea-cc30-4d0e-9a44-829eda93848d taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.580770] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b7d77ea-cc30-4d0e-9a44-829eda93848d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.580833] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b7d77ea-cc30-4d0e-9a44-829eda93848d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.581120] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b7d77ea-cc30-4d0e-9a44-829eda93848d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.582067] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.582067] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.582067] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.582067] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.582067] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.582067] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b7d77ea-cc30-4d0e-9a44-829eda93848d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.862492] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-69913569-f584-45f7-91a4-ec8af89769a9 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.862964] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.862964] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.863117] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.863276] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.863487] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.863560] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.863916] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.863916] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.863916] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.864115] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-69913569-f584-45f7-91a4-ec8af89769a9 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.864175] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.864260] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.864413] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.864636] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.864636] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.864729] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.864837] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.864916] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.865021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.865114] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.005071] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15454ceb-9062-41fb-908b-b5ae144dbe65: rpc.has_security_group_logging(os_id): False [ 850.025019] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.025113] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.025276] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.025382] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.025473] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.025701] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.025797] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.025856] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.026011] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.026092] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.026276] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.026365] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.026456] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.026604] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.026677] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.026852] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.026944] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.027013] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.027554] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.027554] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.027666] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 is going to be created. [ 850.087625] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.087784] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.087838] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.088094] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.088299] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.090520] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.090671] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.090715] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.090887] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.090971] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.091183] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.091609] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.091737] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.091908] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.091988] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.092157] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b7d77ea-cc30-4d0e-9a44-829eda93848d already deleted. [ 850.092402] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b7d77ea-cc30-4d0e-9a44-829eda93848d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.104114] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: IN_PROGRESS for 2s [ 850.106174] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-146 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.106441] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-146" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.106578] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-146" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.106901] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-146" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.107266] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.107440] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.107697] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.107804] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.108019] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.109603] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 850.109603] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 850.109603] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 850.109603] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 850.109603] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 850.109603] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 850.109603] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 850.146194] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 850.146478] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 850.146611] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 850.146793] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-146" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.147223] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-3fa9d838-1fd5-4bd6-ab8b-e300b00004fe taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.147405] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-3fa9d838-1fd5-4bd6-ab8b-e300b00004fe" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.147529] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-3fa9d838-1fd5-4bd6-ab8b-e300b00004fe" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.147870] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-3fa9d838-1fd5-4bd6-ab8b-e300b00004fe" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.148035] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fa9d838-1fd5-4bd6-ab8b-e300b00004fe',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.368017] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69913569-f584-45f7-91a4-ec8af89769a9: rpc.has_security_group_logging(os_id): False [ 850.387604] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.388079] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.388156] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.388365] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.388458] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.388696] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.388811] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.388851] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.389010] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.389088] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.389266] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.389545] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.389545] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.389675] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.389751] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.389970] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.390137] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.391043] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.391275] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.391506] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.391506] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69913569-f584-45f7-91a4-ec8af89769a9 is going to be updated. [ 850.428694] env[65943]: INFO networking_nsxv3.common.synchronization [None req-aa18165e-b528-45c2-bde0-a0c4383ca1ab None None] Enqueued Resource ID: 05551476-2148-4910-90d7-dc60ff4c37ce with Priority: HIGHEST for action port [ 850.429548] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05551476-2148-4910-90d7-dc60ff4c37ce with Priority: HIGHEST for action port [ 850.430390] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-05551476-2148-4910-90d7-dc60ff4c37ce taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.430390] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05551476-2148-4910-90d7-dc60ff4c37ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.430390] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05551476-2148-4910-90d7-dc60ff4c37ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.430390] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05551476-2148-4910-90d7-dc60ff4c37ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.430390] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05551476-2148-4910-90d7-dc60ff4c37ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.464076] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.464076] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.464076] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.464348] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.464348] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.481938] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69913569-f584-45f7-91a4-ec8af89769a9 in Status: IN_PROGRESS for 2s [ 850.651054] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.651298] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.651421] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.652099] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.652492] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.652492] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port 3fa9d838-1fd5-4bd6-ab8b-e300b00004fe not found, creating... [ 850.652681] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.652853] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.652948] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.653215] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.653372] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.653589] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.653731] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.653839] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.656344] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.656344] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.656527] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: 3fa9d838-1fd5-4bd6-ab8b-e300b00004fe is going to be created. [ 850.684593] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.684593] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.684842] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.684929] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.685212] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.685452] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-3fa9d838-1fd5-4bd6-ab8b-e300b00004fe" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.932135] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 05551476-2148-4910-90d7-dc60ff4c37ce [ 850.933642] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.933642] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.933642] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.933816] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.933995] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.934209] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:05551476-2148-4910-90d7-dc60ff4c37ce already deleted. [ 850.934351] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05551476-2148-4910-90d7-dc60ff4c37ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.456637] env[65943]: INFO networking_nsxv3.common.synchronization [req-a2619985-f8a4-4ebc-b457-c64da57112a3 req-e53b946a-8e35-4489-8cb8-aa2cfa248bf2 service nova] Enqueued Resource ID: 2b7d77ea-cc30-4d0e-9a44-829eda93848d with Priority: HIGHEST for action security_group_rules [ 851.456637] env[65943]: INFO networking_nsxv3.common.synchronization [req-a2619985-f8a4-4ebc-b457-c64da57112a3 req-e53b946a-8e35-4489-8cb8-aa2cfa248bf2 service nova] Enqueued Resource ID: 2b7d77ea-cc30-4d0e-9a44-829eda93848d with Priority: HIGHEST for action security_group_members [ 851.456637] env[65943]: INFO networking_nsxv3.common.synchronization [req-a2619985-f8a4-4ebc-b457-c64da57112a3 req-e53b946a-8e35-4489-8cb8-aa2cfa248bf2 service nova] Enqueued Resource ID: 3fa9d838-1fd5-4bd6-ab8b-e300b00004fe with Priority: HIGHEST for action port [ 851.456924] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b7d77ea-cc30-4d0e-9a44-829eda93848d with Priority: HIGHEST for action security_group_rules [ 851.456970] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b7d77ea-cc30-4d0e-9a44-829eda93848d with Priority: HIGHEST for action security_group_members [ 851.460257] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fa9d838-1fd5-4bd6-ab8b-e300b00004fe with Priority: HIGHEST for action port [ 851.460257] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b7d77ea-cc30-4d0e-9a44-829eda93848d taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.460257] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b7d77ea-cc30-4d0e-9a44-829eda93848d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.460257] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b7d77ea-cc30-4d0e-9a44-829eda93848d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.460257] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b7d77ea-cc30-4d0e-9a44-829eda93848d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.460562] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b7d77ea-cc30-4d0e-9a44-829eda93848d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.461302] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b7d77ea-cc30-4d0e-9a44-829eda93848d taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.461430] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b7d77ea-cc30-4d0e-9a44-829eda93848d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.461528] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b7d77ea-cc30-4d0e-9a44-829eda93848d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.461752] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b7d77ea-cc30-4d0e-9a44-829eda93848d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.461900] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.461997] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.462072] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.462212] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.462297] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.462391] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b7d77ea-cc30-4d0e-9a44-829eda93848d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.465176] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-3fa9d838-1fd5-4bd6-ab8b-e300b00004fe taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.465176] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3fa9d838-1fd5-4bd6-ab8b-e300b00004fe" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.465176] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3fa9d838-1fd5-4bd6-ab8b-e300b00004fe" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.465176] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3fa9d838-1fd5-4bd6-ab8b-e300b00004fe" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.465176] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fa9d838-1fd5-4bd6-ab8b-e300b00004fe',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.969727] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b7d77ea-cc30-4d0e-9a44-829eda93848d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.969727] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b7d77ea-cc30-4d0e-9a44-829eda93848d taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.969727] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b7d77ea-cc30-4d0e-9a44-829eda93848d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.969727] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3fa9d838-1fd5-4bd6-ab8b-e300b00004fe with status ACTIVE [ 851.969727] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.969727] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.969727] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.969727] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.969727] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.969727] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.969727] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.969727] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.970637] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.970637] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.970637] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.970637] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.970637] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.970637] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.970637] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.970637] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3fa9d838-1fd5-4bd6-ab8b-e300b00004fe is going to be updated. [ 852.010501] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.010647] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.010706] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.011031] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.011076] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.011243] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3fa9d838-1fd5-4bd6-ab8b-e300b00004fe" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.126833] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: SUCCESS [ 852.127768] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.473585] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b7d77ea-cc30-4d0e-9a44-829eda93848d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.500042] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69913569-f584-45f7-91a4-ec8af89769a9 in Status: SUCCESS [ 852.500042] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.979780] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.979780] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.980210] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.980210] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.980210] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.980327] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b7d77ea-cc30-4d0e-9a44-829eda93848d is going to be created. [ 853.007264] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.007264] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.007264] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.007264] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.007471] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.018088] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b7d77ea-cc30-4d0e-9a44-829eda93848d in Status: UNINITIALIZED for 2s [ 853.137017] env[65943]: INFO networking_nsxv3.common.synchronization [None req-c86aa071-44c5-4e77-a22f-62572522496d None None] Enqueued Resource ID: 9b7859de-ef0c-4e77-8377-76dfa7e7a0ee with Priority: HIGHEST for action port [ 853.137810] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b7859de-ef0c-4e77-8377-76dfa7e7a0ee with Priority: HIGHEST for action port [ 853.138636] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b7859de-ef0c-4e77-8377-76dfa7e7a0ee taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.138726] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b7859de-ef0c-4e77-8377-76dfa7e7a0ee" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.138774] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b7859de-ef0c-4e77-8377-76dfa7e7a0ee" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.139070] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b7859de-ef0c-4e77-8377-76dfa7e7a0ee" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.139167] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b7859de-ef0c-4e77-8377-76dfa7e7a0ee',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.642361] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9b7859de-ef0c-4e77-8377-76dfa7e7a0ee [ 853.643038] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.643038] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.643038] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.643038] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.643366] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.643366] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9b7859de-ef0c-4e77-8377-76dfa7e7a0ee already deleted. [ 853.643366] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b7859de-ef0c-4e77-8377-76dfa7e7a0ee" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.469849] env[65943]: INFO networking_nsxv3.common.synchronization [req-fcf51f33-559d-4b92-9d04-d62bff059dc6 req-39a5ed68-ee51-4bf1-919c-c36698142cb8 tempest-ServerActionsTestJSON-1587559204 tempest-ServerActionsTestJSON-1587559204-project-member] Enqueued Resource ID: 120a53f4-6f9e-423c-b6c7-c18e7f4310a8 with Priority: HIGHEST for action security_group_members [ 854.469849] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 120a53f4-6f9e-423c-b6c7-c18e7f4310a8 with Priority: HIGHEST for action security_group_members [ 854.469849] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-120a53f4-6f9e-423c-b6c7-c18e7f4310a8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.469849] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-120a53f4-6f9e-423c-b6c7-c18e7f4310a8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.469849] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-120a53f4-6f9e-423c-b6c7-c18e7f4310a8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.469849] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-120a53f4-6f9e-423c-b6c7-c18e7f4310a8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.469849] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.469849] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.469849] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.469849] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.469849] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.469849] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('120a53f4-6f9e-423c-b6c7-c18e7f4310a8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.871998] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-287 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.872253] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-287" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.872645] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-287" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.872809] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-287" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.873141] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.873312] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.873462] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.873728] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.874135] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.874135] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 854.874274] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 854.874411] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 854.874636] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 854.874727] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 854.874795] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 854.874951] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 854.898041] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 854.898041] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 854.898041] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 854.898041] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-287" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.898041] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-57dd3e13-f3e4-4844-9048-b86268c089d0 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.898041] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-57dd3e13-f3e4-4844-9048-b86268c089d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.898041] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-57dd3e13-f3e4-4844-9048-b86268c089d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.898776] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-57dd3e13-f3e4-4844-9048-b86268c089d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.899126] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57dd3e13-f3e4-4844-9048-b86268c089d0',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.972795] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.972795] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.972795] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.972795] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.972795] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.972795] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.972795] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.972795] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.972795] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.972795] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.972795] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 120a53f4-6f9e-423c-b6c7-c18e7f4310a8 already deleted. [ 854.972795] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-120a53f4-6f9e-423c-b6c7-c18e7f4310a8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.031430] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b7d77ea-cc30-4d0e-9a44-829eda93848d in Status: SUCCESS [ 855.031430] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b7d77ea-cc30-4d0e-9a44-829eda93848d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.031430] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b7d77ea-cc30-4d0e-9a44-829eda93848d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.031430] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b7d77ea-cc30-4d0e-9a44-829eda93848d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.031430] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.031430] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.031430] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.031430] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.031430] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.031430] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b7d77ea-cc30-4d0e-9a44-829eda93848d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.031430] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2b7d77ea-cc30-4d0e-9a44-829eda93848d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.219570] env[65943]: INFO networking_nsxv3.common.synchronization [req-1018b6e7-8d62-4c53-9b20-c275e7b56b4a req-00887b93-1fa5-4009-80f7-ae51c0f1a1e5 tempest-ServersAdminTestJSON-910281195 tempest-ServersAdminTestJSON-910281195-project-member] Enqueued Resource ID: e02be8c7-70b1-4488-b079-b1ebf20a733c with Priority: HIGHEST for action security_group_members [ 855.220315] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e02be8c7-70b1-4488-b079-b1ebf20a733c with Priority: HIGHEST for action security_group_members [ 855.220315] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e02be8c7-70b1-4488-b079-b1ebf20a733c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.220564] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.220564] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.220713] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.220872] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.220977] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.221046] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.221229] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.221308] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.221404] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.405203] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.405203] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.405203] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.405203] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.405203] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.405203] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port 57dd3e13-f3e4-4844-9048-b86268c089d0 not found, creating... [ 855.405203] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.405203] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.405203] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.405830] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.405830] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.406339] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.406339] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.406778] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.406778] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.406885] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.407167] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: 57dd3e13-f3e4-4844-9048-b86268c089d0 is going to be created. [ 855.440730] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.440957] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.441027] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.441359] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.441618] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.441953] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-57dd3e13-f3e4-4844-9048-b86268c089d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.534201] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b7d77ea-cc30-4d0e-9a44-829eda93848d taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.534570] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b7d77ea-cc30-4d0e-9a44-829eda93848d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.534634] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b7d77ea-cc30-4d0e-9a44-829eda93848d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.534893] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b7d77ea-cc30-4d0e-9a44-829eda93848d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.535284] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.535432] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.535508] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.535656] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.535752] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.536047] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b7d77ea-cc30-4d0e-9a44-829eda93848d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.536047] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b7d77ea-cc30-4d0e-9a44-829eda93848d taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.536208] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b7d77ea-cc30-4d0e-9a44-829eda93848d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.536208] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b7d77ea-cc30-4d0e-9a44-829eda93848d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.536331] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b7d77ea-cc30-4d0e-9a44-829eda93848d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.536521] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.536607] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.536663] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.536807] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.536886] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.536962] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b7d77ea-cc30-4d0e-9a44-829eda93848d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.537633] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2b7d77ea-cc30-4d0e-9a44-829eda93848d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.723812] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.039925] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2b7d77ea-cc30-4d0e-9a44-829eda93848d: rpc.has_security_group_logging(os_id): False [ 856.059156] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.059310] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.059375] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.059626] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.059716] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.059955] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.060036] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.060079] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.060227] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.060305] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.060539] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.060610] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.060674] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.060863] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.060914] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.061462] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.061462] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.061462] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.061626] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.061700] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.061812] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b7d77ea-cc30-4d0e-9a44-829eda93848d is going to be created. [ 856.134024] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.134184] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.134250] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.134878] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.134878] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.146465] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b7d77ea-cc30-4d0e-9a44-829eda93848d in Status: IN_PROGRESS for 2s [ 856.190257] env[65943]: INFO networking_nsxv3.common.synchronization [req-fcf51f33-559d-4b92-9d04-d62bff059dc6 req-c4837da7-8d59-4495-aca4-6a18ee963528 service nova] Enqueued Resource ID: 120a53f4-6f9e-423c-b6c7-c18e7f4310a8 with Priority: HIGHEST for action security_group_rules [ 856.190335] env[65943]: INFO networking_nsxv3.common.synchronization [req-fcf51f33-559d-4b92-9d04-d62bff059dc6 req-c4837da7-8d59-4495-aca4-6a18ee963528 service nova] Enqueued Resource ID: 120a53f4-6f9e-423c-b6c7-c18e7f4310a8 with Priority: HIGHEST for action security_group_members [ 856.190461] env[65943]: INFO networking_nsxv3.common.synchronization [req-fcf51f33-559d-4b92-9d04-d62bff059dc6 req-c4837da7-8d59-4495-aca4-6a18ee963528 service nova] Enqueued Resource ID: 57dd3e13-f3e4-4844-9048-b86268c089d0 with Priority: HIGHEST for action port [ 856.191101] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 120a53f4-6f9e-423c-b6c7-c18e7f4310a8 with Priority: HIGHEST for action security_group_rules [ 856.191161] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 120a53f4-6f9e-423c-b6c7-c18e7f4310a8 with Priority: HIGHEST for action security_group_members [ 856.191286] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57dd3e13-f3e4-4844-9048-b86268c089d0 with Priority: HIGHEST for action port [ 856.191564] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-120a53f4-6f9e-423c-b6c7-c18e7f4310a8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.191715] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-120a53f4-6f9e-423c-b6c7-c18e7f4310a8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.191794] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-120a53f4-6f9e-423c-b6c7-c18e7f4310a8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.191996] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-120a53f4-6f9e-423c-b6c7-c18e7f4310a8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.192211] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('120a53f4-6f9e-423c-b6c7-c18e7f4310a8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.192986] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-120a53f4-6f9e-423c-b6c7-c18e7f4310a8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.193116] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-120a53f4-6f9e-423c-b6c7-c18e7f4310a8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.193183] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-120a53f4-6f9e-423c-b6c7-c18e7f4310a8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.193351] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-120a53f4-6f9e-423c-b6c7-c18e7f4310a8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.193499] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.193595] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.193686] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.193791] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.193875] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.193962] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('120a53f4-6f9e-423c-b6c7-c18e7f4310a8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.196419] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-57dd3e13-f3e4-4844-9048-b86268c089d0 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.196535] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57dd3e13-f3e4-4844-9048-b86268c089d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.196590] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57dd3e13-f3e4-4844-9048-b86268c089d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.196757] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57dd3e13-f3e4-4844-9048-b86268c089d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.196836] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57dd3e13-f3e4-4844-9048-b86268c089d0',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.225593] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.698534] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-120a53f4-6f9e-423c-b6c7-c18e7f4310a8 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.698781] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-120a53f4-6f9e-423c-b6c7-c18e7f4310a8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.698874] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('120a53f4-6f9e-423c-b6c7-c18e7f4310a8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.699856] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 57dd3e13-f3e4-4844-9048-b86268c089d0 with status ACTIVE [ 856.700375] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.700493] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.701321] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.701321] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.701321] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.701321] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.701321] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.701321] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.701662] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.701662] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.702514] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.702514] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.702514] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.702514] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.702514] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.702514] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 57dd3e13-f3e4-4844-9048-b86268c089d0 is going to be updated. [ 856.725171] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.725389] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.725389] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.725586] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.725725] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.725890] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57dd3e13-f3e4-4844-9048-b86268c089d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.727471] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.727578] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.727578] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.728571] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.728571] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.728571] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e02be8c7-70b1-4488-b079-b1ebf20a733c is going to be updated. [ 856.766457] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.766648] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.766742] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.766986] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.767203] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.776687] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e02be8c7-70b1-4488-b079-b1ebf20a733c in Status: IN_PROGRESS for 2s [ 857.204483] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('120a53f4-6f9e-423c-b6c7-c18e7f4310a8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.277624] env[65943]: INFO networking_nsxv3.common.synchronization [req-139d7fd7-2db5-4397-a1ee-b45671a36e0e req-05403c56-54b4-4bbd-9408-9196babf5cc9 tempest-DeleteServersTestJSON-1404918926 tempest-DeleteServersTestJSON-1404918926-project-member] Enqueued Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_members [ 857.278483] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_members [ 857.278860] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.278994] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.279083] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.281261] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.281261] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.281261] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.281261] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.281261] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.281261] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.281261] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.711110] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.711649] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.711649] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.711880] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.712986] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.712986] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 120a53f4-6f9e-423c-b6c7-c18e7f4310a8 is going to be created. [ 857.746274] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.746274] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.746274] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.746505] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.746505] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.759294] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 120a53f4-6f9e-423c-b6c7-c18e7f4310a8 in Status: UNINITIALIZED for 2s [ 857.782950] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.783194] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.783194] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.783446] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.783548] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.783747] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.783870] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.783960] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.784361] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.784361] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.784361] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 is going to be updated. [ 857.816898] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.817093] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.817247] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.817492] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.817863] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.828305] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: IN_PROGRESS for 2s [ 858.160538] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b7d77ea-cc30-4d0e-9a44-829eda93848d in Status: SUCCESS [ 858.160771] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b7d77ea-cc30-4d0e-9a44-829eda93848d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.788238] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e02be8c7-70b1-4488-b079-b1ebf20a733c in Status: SUCCESS [ 858.788611] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.951590] env[65943]: INFO networking_nsxv3.common.synchronization [req-9dbc11f0-79bd-401c-a41c-4f2215530ebf req-ef825183-3647-4c12-989c-52f58c1b9f37 tempest-ServerActionsTestOtherA-92071881 tempest-ServerActionsTestOtherA-92071881-project-member] Enqueued Resource ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 with Priority: HIGHEST for action security_group_members [ 858.952038] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 with Priority: HIGHEST for action security_group_members [ 858.953066] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-89dec01a-fac4-47c6-9d76-7e922dba6ec4 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.953066] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.953066] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.953066] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.953066] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.953066] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.953066] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.953599] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.953599] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.953599] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89dec01a-fac4-47c6-9d76-7e922dba6ec4',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.456600] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.456600] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.456600] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.456877] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.456877] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.457858] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.457858] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.457858] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.457858] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.457858] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.458211] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 is going to be updated. [ 859.491091] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.491405] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.492075] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.492075] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.492291] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.502928] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 in Status: IN_PROGRESS for 2s [ 859.596414] env[65943]: INFO networking_nsxv3.common.synchronization [req-77445d5d-ab6c-401d-b224-cf6a174ae534 req-fdfbaa28-6257-40d1-ab98-54e17b4ce38c tempest-ServerActionsTestOtherB-2092325239 tempest-ServerActionsTestOtherB-2092325239-project-member] Enqueued Resource ID: 2880c629-d8d0-45b5-b939-d99c78caab70 with Priority: HIGHEST for action security_group_members [ 859.597094] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2880c629-d8d0-45b5-b939-d99c78caab70 with Priority: HIGHEST for action security_group_members [ 859.597454] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2880c629-d8d0-45b5-b939-d99c78caab70 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.597576] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.597651] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.597899] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.598070] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.598162] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.598216] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.598376] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.598461] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.598556] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2880c629-d8d0-45b5-b939-d99c78caab70',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.773101] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 120a53f4-6f9e-423c-b6c7-c18e7f4310a8 in Status: SUCCESS [ 859.773101] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-120a53f4-6f9e-423c-b6c7-c18e7f4310a8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.773101] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-120a53f4-6f9e-423c-b6c7-c18e7f4310a8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.773101] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-120a53f4-6f9e-423c-b6c7-c18e7f4310a8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.773101] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.773101] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.773101] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.773101] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.773101] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.773101] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-120a53f4-6f9e-423c-b6c7-c18e7f4310a8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.773101] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('120a53f4-6f9e-423c-b6c7-c18e7f4310a8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.840306] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: SUCCESS [ 859.840615] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 deletion is rescheduled due to dependency. [ 859.840615] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.004423] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-454 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.004633] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-454" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.004754] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-454" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.005327] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-454" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.005461] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.005622] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.005751] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.005983] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.006193] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.006412] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 860.006563] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 860.006674] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 860.006780] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 860.006911] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 860.007032] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 860.007169] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 860.026779] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 860.026779] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 860.026969] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 860.027057] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-454" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.027468] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-b2ea70b9-b14f-4e83-b3cc-a23b9abddeec taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.027656] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-b2ea70b9-b14f-4e83-b3cc-a23b9abddeec" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.027759] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-b2ea70b9-b14f-4e83-b3cc-a23b9abddeec" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.028095] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-b2ea70b9-b14f-4e83-b3cc-a23b9abddeec" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.028260] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2ea70b9-b14f-4e83-b3cc-a23b9abddeec',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.101739] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.101867] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.101914] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.102398] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.102398] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.102519] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.102519] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.102628] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.103639] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.103639] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.103639] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2880c629-d8d0-45b5-b939-d99c78caab70 already deleted. [ 860.103639] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.282557] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('120a53f4-6f9e-423c-b6c7-c18e7f4310a8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.530827] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.531330] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.531330] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.531515] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.531698] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.531879] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port b2ea70b9-b14f-4e83-b3cc-a23b9abddeec not found, creating... [ 860.532194] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.532394] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.532535] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.532786] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.532957] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.533295] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.533458] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.533575] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.533782] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.533911] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.534059] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: b2ea70b9-b14f-4e83-b3cc-a23b9abddeec is going to be created. [ 860.558936] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.559223] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.559359] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.559691] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.559956] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.560238] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-b2ea70b9-b14f-4e83-b3cc-a23b9abddeec" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.785037] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 120a53f4-6f9e-423c-b6c7-c18e7f4310a8: rpc.has_security_group_logging(os_id): False [ 860.805420] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.805635] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.805717] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.805889] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.805983] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.806272] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.806423] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.806491] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.806733] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.806733] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.806863] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 120a53f4-6f9e-423c-b6c7-c18e7f4310a8 is going to be created. [ 860.875325] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.875325] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.875711] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.875711] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.875797] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.889490] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 120a53f4-6f9e-423c-b6c7-c18e7f4310a8 in Status: IN_PROGRESS for 2s [ 861.314900] env[65943]: INFO networking_nsxv3.common.synchronization [req-77445d5d-ab6c-401d-b224-cf6a174ae534 req-363a9f4b-614e-46ed-ab00-ae23f2dad59c service nova] Enqueued Resource ID: 2880c629-d8d0-45b5-b939-d99c78caab70 with Priority: HIGHEST for action security_group_rules [ 861.315234] env[65943]: INFO networking_nsxv3.common.synchronization [req-77445d5d-ab6c-401d-b224-cf6a174ae534 req-363a9f4b-614e-46ed-ab00-ae23f2dad59c service nova] Enqueued Resource ID: 2880c629-d8d0-45b5-b939-d99c78caab70 with Priority: HIGHEST for action security_group_members [ 861.315623] env[65943]: INFO networking_nsxv3.common.synchronization [req-77445d5d-ab6c-401d-b224-cf6a174ae534 req-363a9f4b-614e-46ed-ab00-ae23f2dad59c service nova] Enqueued Resource ID: b2ea70b9-b14f-4e83-b3cc-a23b9abddeec with Priority: HIGHEST for action port [ 861.316563] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2880c629-d8d0-45b5-b939-d99c78caab70 with Priority: HIGHEST for action security_group_rules [ 861.316695] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2880c629-d8d0-45b5-b939-d99c78caab70 with Priority: HIGHEST for action security_group_members [ 861.316895] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2ea70b9-b14f-4e83-b3cc-a23b9abddeec with Priority: HIGHEST for action port [ 861.317377] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2880c629-d8d0-45b5-b939-d99c78caab70 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.317502] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.317568] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.317823] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.317908] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2880c629-d8d0-45b5-b939-d99c78caab70',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.319360] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2880c629-d8d0-45b5-b939-d99c78caab70 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.319548] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.319613] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.319767] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.319964] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.320060] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.320123] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.320275] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.320365] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.320500] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2880c629-d8d0-45b5-b939-d99c78caab70',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.321362] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2ea70b9-b14f-4e83-b3cc-a23b9abddeec taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.321468] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2ea70b9-b14f-4e83-b3cc-a23b9abddeec" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.322480] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2ea70b9-b14f-4e83-b3cc-a23b9abddeec" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.322480] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2ea70b9-b14f-4e83-b3cc-a23b9abddeec" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.322480] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2ea70b9-b14f-4e83-b3cc-a23b9abddeec',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.377370] env[65943]: INFO networking_nsxv3.common.synchronization [req-eac3d2c5-dd6d-4e48-9453-6e2cc88eef91 req-01f3e608-6692-4148-a2a3-6828ab2c87ec tempest-ListServersNegativeTestJSON-1591552957 tempest-ListServersNegativeTestJSON-1591552957-project-member] Enqueued Resource ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf with Priority: HIGHEST for action security_group_members [ 861.378055] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf with Priority: HIGHEST for action security_group_members [ 861.378775] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.378775] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.378938] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.379109] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.379373] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.379565] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.379673] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.379961] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.380127] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.380277] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cddfb2d8-8ac5-496b-aee4-ea09e6b59edf',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.515655] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 in Status: SUCCESS [ 861.515952] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 deletion is rescheduled due to dependency. [ 861.516475] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.670872] env[65943]: INFO networking_nsxv3.common.synchronization [req-e758da11-3710-4bd1-827d-ee9eb4095968 req-787eaa30-75a9-4e3e-9557-3bf1b82b9cef tempest-ListServersNegativeTestJSON-1591552957 tempest-ListServersNegativeTestJSON-1591552957-project-member] Enqueued Resource ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf with Priority: HIGHEST for action security_group_members [ 861.671788] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf with Priority: HIGHEST for action security_group_members [ 861.672399] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.672399] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.825075] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2880c629-d8d0-45b5-b939-d99c78caab70 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.825289] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.827061] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2880c629-d8d0-45b5-b939-d99c78caab70',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.828115] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b2ea70b9-b14f-4e83-b3cc-a23b9abddeec with status ACTIVE [ 861.828354] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.828484] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.828560] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.828797] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.829059] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.829249] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.829249] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.829777] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.829777] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.829777] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.831029] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.831029] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.831214] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.831214] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.831305] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.833377] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b2ea70b9-b14f-4e83-b3cc-a23b9abddeec is going to be updated. [ 861.854106] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.854278] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.854340] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.854549] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.854690] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.854852] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2ea70b9-b14f-4e83-b3cc-a23b9abddeec" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.882802] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cddfb2d8-8ac5-496b-aee4-ea09e6b59edf',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.333745] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2880c629-d8d0-45b5-b939-d99c78caab70',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.386019] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cddfb2d8-8ac5-496b-aee4-ea09e6b59edf',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.402685] env[65943]: INFO networking_nsxv3.common.synchronization [req-9555dbde-1110-4379-a545-67d3106c51e0 req-6d28237f-3df6-4506-95b6-0ceed5f56d41 tempest-ImagesTestJSON-196343566 tempest-ImagesTestJSON-196343566-project-member] Enqueued Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_members [ 862.402685] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_members [ 862.403481] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c81f5e-9888-4914-ab90-42d06116db49 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.403481] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.403481] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.404624] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.404624] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.404624] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.404624] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.404624] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.404624] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.404624] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.837404] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.837659] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.837781] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.838033] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.838136] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.838270] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2880c629-d8d0-45b5-b939-d99c78caab70 is going to be created. [ 862.870155] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.870155] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.870155] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.870155] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.870155] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.881048] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2880c629-d8d0-45b5-b939-d99c78caab70 in Status: UNINITIALIZED for 2s [ 862.887906] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.888318] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.888318] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.888539] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.888539] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.888623] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf is going to be updated. [ 862.895667] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-40 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.895868] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-40" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.896044] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-40" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.896325] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-40" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.896604] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.896790] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.896917] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.897396] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.897613] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.897872] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 862.898051] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 862.898242] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 862.898507] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 862.898775] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 862.899237] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 862.899528] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 862.901628] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 120a53f4-6f9e-423c-b6c7-c18e7f4310a8 in Status: SUCCESS [ 862.901963] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-120a53f4-6f9e-423c-b6c7-c18e7f4310a8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.906799] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.907426] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.907426] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.907426] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.922743] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 862.923039] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 862.923190] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 862.923344] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-40" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.923719] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-da8af608-3fb6-4fe5-92bb-7dbb475219d1 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.923909] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-da8af608-3fb6-4fe5-92bb-7dbb475219d1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.924065] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-da8af608-3fb6-4fe5-92bb-7dbb475219d1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.924506] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-da8af608-3fb6-4fe5-92bb-7dbb475219d1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.924595] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da8af608-3fb6-4fe5-92bb-7dbb475219d1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.926654] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.926786] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.926854] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.927071] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.927272] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.933644] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.933908] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.934818] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.934818] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.934818] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.934818] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.934818] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c81f5e-9888-4914-ab90-42d06116db49 is going to be updated. [ 862.937475] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf in Status: IN_PROGRESS for 2s [ 862.969600] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.969600] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.969600] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.969600] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.969600] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.978381] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c81f5e-9888-4914-ab90-42d06116db49 in Status: IN_PROGRESS for 2s [ 863.429901] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.430225] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.430325] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.430600] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.430750] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.430923] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port da8af608-3fb6-4fe5-92bb-7dbb475219d1 not found, creating... [ 863.431235] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.431406] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.431534] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.431775] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.431933] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.432259] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.432418] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.432533] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.432762] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.432915] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.433089] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: da8af608-3fb6-4fe5-92bb-7dbb475219d1 is going to be created. [ 863.455126] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.455480] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.455638] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.455919] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.456172] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.456422] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-da8af608-3fb6-4fe5-92bb-7dbb475219d1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.206301] env[65943]: INFO networking_nsxv3.common.synchronization [req-9555dbde-1110-4379-a545-67d3106c51e0 req-e09bdc3f-434d-4fa5-bfb4-f7510a5f3e98 service nova] Enqueued Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_rules [ 864.206301] env[65943]: INFO networking_nsxv3.common.synchronization [req-9555dbde-1110-4379-a545-67d3106c51e0 req-e09bdc3f-434d-4fa5-bfb4-f7510a5f3e98 service nova] Enqueued Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_members [ 864.206301] env[65943]: INFO networking_nsxv3.common.synchronization [req-9555dbde-1110-4379-a545-67d3106c51e0 req-e09bdc3f-434d-4fa5-bfb4-f7510a5f3e98 service nova] Enqueued Resource ID: da8af608-3fb6-4fe5-92bb-7dbb475219d1 with Priority: HIGHEST for action port [ 864.206996] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_rules [ 864.207073] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_members [ 864.207156] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da8af608-3fb6-4fe5-92bb-7dbb475219d1 with Priority: HIGHEST for action port [ 864.207515] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0c81f5e-9888-4914-ab90-42d06116db49 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.207672] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.207733] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.208092] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.208092] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.209000] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c81f5e-9888-4914-ab90-42d06116db49 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.209140] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.209387] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-da8af608-3fb6-4fe5-92bb-7dbb475219d1 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.209496] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da8af608-3fb6-4fe5-92bb-7dbb475219d1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.209496] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da8af608-3fb6-4fe5-92bb-7dbb475219d1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.209691] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da8af608-3fb6-4fe5-92bb-7dbb475219d1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.209774] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da8af608-3fb6-4fe5-92bb-7dbb475219d1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.566218] env[65943]: INFO networking_nsxv3.common.synchronization [req-07090f35-9786-413b-8bc3-e34031416be4 req-190dc9df-a85f-46ac-ab80-42b0729e5ab6 tempest-ServersNegativeTestMultiTenantJSON-1688087976 tempest-ServersNegativeTestMultiTenantJSON-1688087976-project-member] Enqueued Resource ID: 2b7d77ea-cc30-4d0e-9a44-829eda93848d with Priority: HIGHEST for action security_group_members [ 864.566743] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b7d77ea-cc30-4d0e-9a44-829eda93848d with Priority: HIGHEST for action security_group_members [ 864.568872] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b7d77ea-cc30-4d0e-9a44-829eda93848d taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.569238] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b7d77ea-cc30-4d0e-9a44-829eda93848d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.569418] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b7d77ea-cc30-4d0e-9a44-829eda93848d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.569844] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b7d77ea-cc30-4d0e-9a44-829eda93848d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.570181] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.570513] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.570704] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.571090] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.571417] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.571782] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b7d77ea-cc30-4d0e-9a44-829eda93848d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.712127] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c81f5e-9888-4914-ab90-42d06116db49 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.712332] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.712568] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port da8af608-3fb6-4fe5-92bb-7dbb475219d1 with status ACTIVE [ 864.712756] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.712908] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.712997] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.713697] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.714060] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.714060] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.714206] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.714206] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.714371] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.714429] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.714654] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.714771] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.714835] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.715025] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.715107] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.715194] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: da8af608-3fb6-4fe5-92bb-7dbb475219d1 is going to be updated. [ 864.754656] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.754656] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.754656] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.754932] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.754932] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.755140] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da8af608-3fb6-4fe5-92bb-7dbb475219d1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.892538] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2880c629-d8d0-45b5-b939-d99c78caab70 in Status: SUCCESS [ 864.892781] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.892959] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.893221] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.893426] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.893542] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.893610] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.894073] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.894172] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.894256] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.894350] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2880c629-d8d0-45b5-b939-d99c78caab70',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.951148] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf in Status: SUCCESS [ 864.951520] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.951639] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.951870] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.952082] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.952204] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.952268] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.952421] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.952501] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.952595] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cddfb2d8-8ac5-496b-aee4-ea09e6b59edf',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.987999] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c81f5e-9888-4914-ab90-42d06116db49 in Status: SUCCESS [ 864.988216] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c81f5e-9888-4914-ab90-42d06116db49 deletion is rescheduled due to dependency. [ 864.988417] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.988687] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.990211] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.990211] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.990211] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.990211] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.990211] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.990211] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.990211] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.074064] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.074238] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.074309] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.074528] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.075381] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.075381] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.075381] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.075381] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.075381] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.075381] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.075381] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b7d77ea-cc30-4d0e-9a44-829eda93848d is going to be updated. [ 865.103640] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.103818] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.103909] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.104192] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.104375] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.114942] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b7d77ea-cc30-4d0e-9a44-829eda93848d in Status: IN_PROGRESS for 2s [ 865.142755] env[65943]: INFO networking_nsxv3.common.synchronization [req-951f7420-b2a1-4b11-b149-3074245e64a6 req-4c8f1a20-d193-4bb8-962c-3a7682c3e060 tempest-ServersNegativeTestJSON-1424653399 tempest-ServersNegativeTestJSON-1424653399-project-member] Enqueued Resource ID: 55c4b60d-641f-4044-8228-251f73d38ecb with Priority: HIGHEST for action security_group_members [ 865.145019] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55c4b60d-641f-4044-8228-251f73d38ecb with Priority: HIGHEST for action security_group_members [ 865.145019] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-55c4b60d-641f-4044-8228-251f73d38ecb taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.145019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.145019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.145019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.145019] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.145019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.145019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.145019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.145019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.145019] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55c4b60d-641f-4044-8228-251f73d38ecb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.397511] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2880c629-d8d0-45b5-b939-d99c78caab70',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.456340] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.460220] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.460220] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.460220] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.460220] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.460220] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.460220] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.460220] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.460220] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.460220] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.460220] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf is going to be updated. [ 865.491724] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.493606] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.493769] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.493838] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.494031] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.494170] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.505459] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf in Status: IN_PROGRESS for 2s [ 865.650678] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55c4b60d-641f-4044-8228-251f73d38ecb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.739492] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-737 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.739695] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-737" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.739817] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-737" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.740110] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-737" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.740369] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.740533] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.740651] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.740874] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.741468] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.741843] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 865.742046] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 865.742198] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 865.742280] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 865.742509] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 865.742509] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 865.742618] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 865.765045] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 865.765045] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 865.765045] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 865.765045] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-737" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.765697] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-d614de84-9627-4ffb-83f9-1f4613d1dc42 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.765784] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-d614de84-9627-4ffb-83f9-1f4613d1dc42" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.765902] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-d614de84-9627-4ffb-83f9-1f4613d1dc42" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.766243] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-d614de84-9627-4ffb-83f9-1f4613d1dc42" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.766394] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d614de84-9627-4ffb-83f9-1f4613d1dc42',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.901808] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2880c629-d8d0-45b5-b939-d99c78caab70: rpc.has_security_group_logging(os_id): False [ 865.922342] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.922342] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.922342] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.922342] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.922342] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.922704] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.922704] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.922842] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.922894] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.923033] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.923085] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2880c629-d8d0-45b5-b939-d99c78caab70 is going to be created. [ 865.993210] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.993210] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.993210] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.993363] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.993882] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.997136] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.005823] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2880c629-d8d0-45b5-b939-d99c78caab70 in Status: IN_PROGRESS for 2s [ 866.151998] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55c4b60d-641f-4044-8228-251f73d38ecb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.269268] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.269556] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.269672] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.269997] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.270169] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.270357] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port d614de84-9627-4ffb-83f9-1f4613d1dc42 not found, creating... [ 866.270696] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.270860] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.270981] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.271216] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.271372] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.273541] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.273772] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.273943] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.274323] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.274470] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.274650] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: d614de84-9627-4ffb-83f9-1f4613d1dc42 is going to be created. [ 866.304649] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.304649] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.304649] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.305366] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.305366] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.305915] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-d614de84-9627-4ffb-83f9-1f4613d1dc42" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.501570] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.501879] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.501879] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.502080] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.502177] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.502289] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c81f5e-9888-4914-ab90-42d06116db49 is going to be updated. [ 866.535679] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.535857] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.535935] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.536159] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.536260] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.546303] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c81f5e-9888-4914-ab90-42d06116db49 in Status: IN_PROGRESS for 2s [ 866.659730] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.660019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.660019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.660265] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.660355] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.660576] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55c4b60d-641f-4044-8228-251f73d38ecb is going to be updated. [ 866.709178] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.709419] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.709506] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.709793] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.709984] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.723653] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55c4b60d-641f-4044-8228-251f73d38ecb in Status: IN_PROGRESS for 2s [ 867.013333] env[65943]: INFO networking_nsxv3.common.synchronization [req-951f7420-b2a1-4b11-b149-3074245e64a6 req-43a7001a-4018-47b8-8c21-739890435071 service nova] Enqueued Resource ID: 55c4b60d-641f-4044-8228-251f73d38ecb with Priority: HIGHEST for action security_group_rules [ 867.016088] env[65943]: INFO networking_nsxv3.common.synchronization [req-951f7420-b2a1-4b11-b149-3074245e64a6 req-43a7001a-4018-47b8-8c21-739890435071 service nova] Enqueued Resource ID: 55c4b60d-641f-4044-8228-251f73d38ecb with Priority: HIGHEST for action security_group_members [ 867.016088] env[65943]: INFO networking_nsxv3.common.synchronization [req-951f7420-b2a1-4b11-b149-3074245e64a6 req-43a7001a-4018-47b8-8c21-739890435071 service nova] Enqueued Resource ID: d614de84-9627-4ffb-83f9-1f4613d1dc42 with Priority: HIGHEST for action port [ 867.016088] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55c4b60d-641f-4044-8228-251f73d38ecb with Priority: HIGHEST for action security_group_rules [ 867.016088] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55c4b60d-641f-4044-8228-251f73d38ecb with Priority: HIGHEST for action security_group_members [ 867.016088] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d614de84-9627-4ffb-83f9-1f4613d1dc42 with Priority: HIGHEST for action port [ 867.016088] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55c4b60d-641f-4044-8228-251f73d38ecb taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.016088] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.016088] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.016088] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.016088] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55c4b60d-641f-4044-8228-251f73d38ecb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.020036] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-55c4b60d-641f-4044-8228-251f73d38ecb taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.020036] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.020036] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-d614de84-9627-4ffb-83f9-1f4613d1dc42 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.020036] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d614de84-9627-4ffb-83f9-1f4613d1dc42" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.020036] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d614de84-9627-4ffb-83f9-1f4613d1dc42" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.020363] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d614de84-9627-4ffb-83f9-1f4613d1dc42" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.020363] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d614de84-9627-4ffb-83f9-1f4613d1dc42',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.129998] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b7d77ea-cc30-4d0e-9a44-829eda93848d in Status: SUCCESS [ 867.130269] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b7d77ea-cc30-4d0e-9a44-829eda93848d deletion is rescheduled due to dependency. [ 867.130401] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b7d77ea-cc30-4d0e-9a44-829eda93848d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.517647] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf in Status: SUCCESS [ 867.517647] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cddfb2d8-8ac5-496b-aee4-ea09e6b59edf deletion is rescheduled due to dependency. [ 867.517647] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cddfb2d8-8ac5-496b-aee4-ea09e6b59edf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.521844] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-55c4b60d-641f-4044-8228-251f73d38ecb taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.521844] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.522077] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d614de84-9627-4ffb-83f9-1f4613d1dc42 with status ACTIVE [ 867.522433] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.522433] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.522433] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.522647] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.522728] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.522912] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.523037] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.523093] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.523238] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.523314] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.523495] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.523583] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.523643] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.523824] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.523879] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.523920] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d614de84-9627-4ffb-83f9-1f4613d1dc42 is going to be updated. [ 867.547128] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.547128] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.547128] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.547400] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.547504] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.547702] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d614de84-9627-4ffb-83f9-1f4613d1dc42" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.020661] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2880c629-d8d0-45b5-b939-d99c78caab70 in Status: SUCCESS [ 868.020661] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.075978] env[65943]: INFO networking_nsxv3.common.synchronization [req-18e69e74-e80a-4d5c-8360-4dfe67430d8c req-69e56a44-8010-4232-b672-ed4f6a3af529 tempest-TenantUsagesTestJSON-1768721863 tempest-TenantUsagesTestJSON-1768721863-project-member] Enqueued Resource ID: 7c5e3a29-0bf9-4a6e-acfc-b7c273d94476 with Priority: HIGHEST for action security_group_members [ 868.076758] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c5e3a29-0bf9-4a6e-acfc-b7c273d94476 with Priority: HIGHEST for action security_group_members [ 868.077113] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.077290] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.077547] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.077709] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.077959] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.078233] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.078378] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.079183] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.079248] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.079352] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c5e3a29-0bf9-4a6e-acfc-b7c273d94476',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.453021] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-651 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.453021] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.453551] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.455901] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.455901] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.455901] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.455901] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.455901] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.455901] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.455901] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 868.455901] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 868.456598] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 868.456598] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 868.456598] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 868.456598] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 868.456825] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 868.478036] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 868.478185] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 868.478309] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 868.478468] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.478796] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-476b049c-4f4b-40bf-8c63-3abcf54d0318 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.478969] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-476b049c-4f4b-40bf-8c63-3abcf54d0318" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.479105] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-476b049c-4f4b-40bf-8c63-3abcf54d0318" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.479814] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-476b049c-4f4b-40bf-8c63-3abcf54d0318" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.479814] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('476b049c-4f4b-40bf-8c63-3abcf54d0318',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.559929] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c81f5e-9888-4914-ab90-42d06116db49 in Status: SUCCESS [ 868.560272] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.560346] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.560560] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.560741] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.560859] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.560966] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.561092] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.561164] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.561250] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.561446] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.581866] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.582145] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.582221] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.582440] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.582564] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.582776] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.582874] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.582932] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.583114] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.583187] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.583267] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c5e3a29-0bf9-4a6e-acfc-b7c273d94476 already deleted. [ 868.583344] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.737032] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55c4b60d-641f-4044-8228-251f73d38ecb in Status: SUCCESS [ 868.737032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.737289] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.737430] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.737603] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.737782] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.737782] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.737930] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.738019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.738118] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55c4b60d-641f-4044-8228-251f73d38ecb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.983317] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.983727] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.983727] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.983970] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.984123] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.984279] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port 476b049c-4f4b-40bf-8c63-3abcf54d0318 not found, creating... [ 868.984573] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.984728] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.984861] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.985109] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.985271] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.985573] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.985734] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.985851] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.986918] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.987582] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.987582] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: 476b049c-4f4b-40bf-8c63-3abcf54d0318 is going to be created. [ 869.010306] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.010550] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.010725] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.011105] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.011307] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.011577] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-476b049c-4f4b-40bf-8c63-3abcf54d0318" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.063903] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c81f5e-9888-4914-ab90-42d06116db49 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.064310] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.065269] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.065455] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.065740] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.065910] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.065994] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.066284] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.066416] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.066528] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.066747] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c81f5e-9888-4914-ab90-42d06116db49 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.066909] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.066991] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.067176] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.067380] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.067518] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.067603] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.067782] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.067886] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.067989] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.068148] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.240020] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55c4b60d-641f-4044-8228-251f73d38ecb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.570680] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0c81f5e-9888-4914-ab90-42d06116db49: rpc.has_security_group_logging(os_id): False [ 869.590135] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.590268] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.590547] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.590623] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.590708] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.590902] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.590999] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.591072] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.591220] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.591297] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.591908] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.591908] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.591908] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.591908] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.591908] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.592197] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.593846] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.594509] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.594708] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.594796] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.594902] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0c81f5e-9888-4914-ab90-42d06116db49 is going to be updated. [ 869.666138] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.666292] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.666387] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.666632] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.666780] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.692350] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0c81f5e-9888-4914-ab90-42d06116db49 in Status: IN_PROGRESS for 2s [ 869.744051] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55c4b60d-641f-4044-8228-251f73d38ecb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.796269] env[65943]: INFO networking_nsxv3.common.synchronization [req-18e69e74-e80a-4d5c-8360-4dfe67430d8c req-1b3f67e6-0f3a-48e3-a64f-77d8b1d82bb4 service nova] Enqueued Resource ID: 7c5e3a29-0bf9-4a6e-acfc-b7c273d94476 with Priority: HIGHEST for action security_group_rules [ 869.796501] env[65943]: INFO networking_nsxv3.common.synchronization [req-18e69e74-e80a-4d5c-8360-4dfe67430d8c req-1b3f67e6-0f3a-48e3-a64f-77d8b1d82bb4 service nova] Enqueued Resource ID: 7c5e3a29-0bf9-4a6e-acfc-b7c273d94476 with Priority: HIGHEST for action security_group_members [ 869.796603] env[65943]: INFO networking_nsxv3.common.synchronization [req-18e69e74-e80a-4d5c-8360-4dfe67430d8c req-1b3f67e6-0f3a-48e3-a64f-77d8b1d82bb4 service nova] Enqueued Resource ID: 476b049c-4f4b-40bf-8c63-3abcf54d0318 with Priority: HIGHEST for action port [ 869.797144] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c5e3a29-0bf9-4a6e-acfc-b7c273d94476 with Priority: HIGHEST for action security_group_rules [ 869.797363] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c5e3a29-0bf9-4a6e-acfc-b7c273d94476 with Priority: HIGHEST for action security_group_members [ 869.797486] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 476b049c-4f4b-40bf-8c63-3abcf54d0318 with Priority: HIGHEST for action port [ 869.797768] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.797894] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.797962] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.798516] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.798516] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c5e3a29-0bf9-4a6e-acfc-b7c273d94476',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.799750] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.799866] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.799929] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.800125] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.800288] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.800388] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.800554] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.800630] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.800681] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.800761] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c5e3a29-0bf9-4a6e-acfc-b7c273d94476',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.801603] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-476b049c-4f4b-40bf-8c63-3abcf54d0318 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.801821] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-476b049c-4f4b-40bf-8c63-3abcf54d0318" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.801874] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-476b049c-4f4b-40bf-8c63-3abcf54d0318" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.802094] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-476b049c-4f4b-40bf-8c63-3abcf54d0318" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.802220] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('476b049c-4f4b-40bf-8c63-3abcf54d0318',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.246594] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.246840] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.246840] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.249288] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.249473] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.249473] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55c4b60d-641f-4044-8228-251f73d38ecb is going to be updated. [ 870.285720] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.285994] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.285994] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.286212] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.286368] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.298377] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55c4b60d-641f-4044-8228-251f73d38ecb in Status: IN_PROGRESS for 2s [ 870.304090] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c5e3a29-0bf9-4a6e-acfc-b7c273d94476',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.310495] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.310495] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.310495] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 476b049c-4f4b-40bf-8c63-3abcf54d0318 with status ACTIVE [ 870.310495] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.310495] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.310495] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.310495] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.310495] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.310495] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.310495] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.310495] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.310495] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.310495] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.310495] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.311375] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.311375] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.311375] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.311375] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.311375] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 476b049c-4f4b-40bf-8c63-3abcf54d0318 is going to be updated. [ 870.335910] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.336205] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.336205] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.336406] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.336576] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.336718] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-476b049c-4f4b-40bf-8c63-3abcf54d0318" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.809284] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c5e3a29-0bf9-4a6e-acfc-b7c273d94476',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.920452] env[65943]: INFO networking_nsxv3.common.synchronization [req-93e1a6ab-83cd-4576-b6de-0b32e83866b2 req-dc38a323-dde6-4f4e-894b-e42b39c00157 tempest-ImagesOneServerNegativeTestJSON-477600040 tempest-ImagesOneServerNegativeTestJSON-477600040-project-member] Enqueued Resource ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d with Priority: HIGHEST for action security_group_members [ 870.921038] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d with Priority: HIGHEST for action security_group_members [ 870.921336] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b23ffb1-731f-42f8-bb4b-c106291be34d taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.921453] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.921516] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.921706] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.922089] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.922089] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.922089] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.922272] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.922272] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.922377] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b23ffb1-731f-42f8-bb4b-c106291be34d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.262787] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-257 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.263031] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-257" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.265237] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-257" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.265732] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-257" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.266666] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.266980] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.267263] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.267591] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.267864] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.269708] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 871.269991] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 871.270248] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 871.270416] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 871.270666] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 871.270885] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 871.271069] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 871.292529] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 871.292724] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 871.292892] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 871.293208] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-257" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.293712] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-1002a482-b43f-4c51-80dc-227f7ad1d084 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.293975] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-1002a482-b43f-4c51-80dc-227f7ad1d084" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.294196] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-1002a482-b43f-4c51-80dc-227f7ad1d084" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.294603] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-1002a482-b43f-4c51-80dc-227f7ad1d084" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.294809] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1002a482-b43f-4c51-80dc-227f7ad1d084',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.312632] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.312813] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.312861] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.313084] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.313177] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.313882] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c5e3a29-0bf9-4a6e-acfc-b7c273d94476 is going to be created. [ 871.337493] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.337713] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.337713] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.337911] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.338090] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.349132] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c5e3a29-0bf9-4a6e-acfc-b7c273d94476 in Status: UNINITIALIZED for 2s [ 871.426737] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.426876] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.426950] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.427307] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.427307] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.427522] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.427631] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.427692] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.427854] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.427972] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.428018] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d is going to be deleted. [ 871.500096] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.500337] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.500337] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.500609] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.500729] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.500776] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.708059] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0c81f5e-9888-4914-ab90-42d06116db49 in Status: SUCCESS [ 871.708059] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.798054] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.798054] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.798054] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.798632] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.798920] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.799211] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port 1002a482-b43f-4c51-80dc-227f7ad1d084 not found, creating... [ 871.800321] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.800321] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.800321] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.800321] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.800662] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.801089] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.803951] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.803951] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.803951] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.803951] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.803951] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: 1002a482-b43f-4c51-80dc-227f7ad1d084 is going to be created. [ 871.829074] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.829074] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.829074] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.829074] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.829074] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.829074] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-1002a482-b43f-4c51-80dc-227f7ad1d084" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.312369] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55c4b60d-641f-4044-8228-251f73d38ecb in Status: SUCCESS [ 872.312567] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.312827] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.313743] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.314508] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.314508] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.314508] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.314965] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.314965] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.316313] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.316313] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55c4b60d-641f-4044-8228-251f73d38ecb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.653739] env[65943]: INFO networking_nsxv3.common.synchronization [req-93e1a6ab-83cd-4576-b6de-0b32e83866b2 req-20dd7e41-156d-4aed-8eaf-e71795d0dd2b service nova] Enqueued Resource ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d with Priority: HIGHEST for action security_group_rules [ 872.653991] env[65943]: INFO networking_nsxv3.common.synchronization [req-93e1a6ab-83cd-4576-b6de-0b32e83866b2 req-20dd7e41-156d-4aed-8eaf-e71795d0dd2b service nova] Enqueued Resource ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d with Priority: HIGHEST for action security_group_members [ 872.654428] env[65943]: INFO networking_nsxv3.common.synchronization [req-93e1a6ab-83cd-4576-b6de-0b32e83866b2 req-20dd7e41-156d-4aed-8eaf-e71795d0dd2b service nova] Enqueued Resource ID: 1002a482-b43f-4c51-80dc-227f7ad1d084 with Priority: HIGHEST for action port [ 872.655313] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d with Priority: HIGHEST for action security_group_rules [ 872.655313] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d with Priority: HIGHEST for action security_group_members [ 872.655313] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1002a482-b43f-4c51-80dc-227f7ad1d084 with Priority: HIGHEST for action port [ 872.655510] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b23ffb1-731f-42f8-bb4b-c106291be34d taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.655681] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.655738] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.655933] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.656031] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b23ffb1-731f-42f8-bb4b-c106291be34d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.657761] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b23ffb1-731f-42f8-bb4b-c106291be34d taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.657889] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.658178] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.658282] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.658514] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.658631] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.658731] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.658881] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.659015] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.659186] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b23ffb1-731f-42f8-bb4b-c106291be34d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.660569] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-1002a482-b43f-4c51-80dc-227f7ad1d084 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.660697] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1002a482-b43f-4c51-80dc-227f7ad1d084" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.660738] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1002a482-b43f-4c51-80dc-227f7ad1d084" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.660920] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1002a482-b43f-4c51-80dc-227f7ad1d084" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.661033] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1002a482-b43f-4c51-80dc-227f7ad1d084',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.819487] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-55c4b60d-641f-4044-8228-251f73d38ecb taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.819729] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.819807] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.820029] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.820383] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.820560] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.820656] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.820836] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.820928] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.821035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.821248] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-55c4b60d-641f-4044-8228-251f73d38ecb taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.821376] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.821461] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.821676] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.821834] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.821929] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.821992] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.822143] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.822226] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.822396] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.822396] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55c4b60d-641f-4044-8228-251f73d38ecb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.158902] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b23ffb1-731f-42f8-bb4b-c106291be34d taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.159229] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.163600] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4b23ffb1-731f-42f8-bb4b-c106291be34d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.165170] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1002a482-b43f-4c51-80dc-227f7ad1d084 with status ACTIVE [ 873.166564] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.166564] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.166564] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.166564] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.166564] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.166564] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.166564] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.166564] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.166564] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.166876] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.166876] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.166966] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.166966] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.167545] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.167545] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.167642] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1002a482-b43f-4c51-80dc-227f7ad1d084 is going to be updated. [ 873.193855] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.194626] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.194714] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.194945] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.195116] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.195322] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1002a482-b43f-4c51-80dc-227f7ad1d084" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.326033] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55c4b60d-641f-4044-8228-251f73d38ecb: rpc.has_security_group_logging(os_id): False [ 873.351753] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.356648] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.356648] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.356648] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.369043] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c5e3a29-0bf9-4a6e-acfc-b7c273d94476 in Status: SUCCESS [ 873.369422] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.369723] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.372007] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.372454] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.372600] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.372727] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.372992] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.373156] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.373286] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.373404] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7c5e3a29-0bf9-4a6e-acfc-b7c273d94476',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.382408] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.383053] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.383242] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.383340] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.383584] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.383754] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.384044] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.384188] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.384260] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.384463] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.384530] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.384725] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.384845] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.384908] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.385120] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.385229] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.385323] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55c4b60d-641f-4044-8228-251f73d38ecb is going to be updated. [ 873.464025] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.464025] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.464025] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.464025] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.464025] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.479345] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55c4b60d-641f-4044-8228-251f73d38ecb in Status: IN_PROGRESS for 2s [ 873.670914] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4b23ffb1-731f-42f8-bb4b-c106291be34d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.879032] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.879032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.879032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.879032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.879032] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.879032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.879032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.879032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.879032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.879032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.879032] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.879032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.879032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.879032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.879032] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.879032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.879621] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.879621] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.879621] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.879621] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.879621] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7c5e3a29-0bf9-4a6e-acfc-b7c273d94476',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.172809] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.173116] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.173116] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.173309] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.173405] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.173670] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d is going to be created. [ 874.201508] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.201688] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.201688] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.202452] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.202452] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.213739] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d in Status: UNINITIALIZED for 2s [ 874.322300] env[65943]: INFO networking_nsxv3.common.synchronization [None req-24050903-5159-41ed-8e0d-8f3c09def383 tempest-ServerRescueNegativeTestJSON-734649129 tempest-ServerRescueNegativeTestJSON-734649129-project-member] Enqueued Resource ID: 7bf10448-5be8-4851-a7f0-5ce51163751a with Priority: HIGHEST for action security_group_rules [ 874.322475] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bf10448-5be8-4851-a7f0-5ce51163751a with Priority: HIGHEST for action security_group_rules [ 874.323055] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7bf10448-5be8-4851-a7f0-5ce51163751a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.323826] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7bf10448-5be8-4851-a7f0-5ce51163751a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.324078] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7bf10448-5be8-4851-a7f0-5ce51163751a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.324682] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7bf10448-5be8-4851-a7f0-5ce51163751a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.324812] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7bf10448-5be8-4851-a7f0-5ce51163751a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.382637] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7c5e3a29-0bf9-4a6e-acfc-b7c273d94476: rpc.has_security_group_logging(os_id): False [ 874.403825] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.403989] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.404051] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.404273] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.404362] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.404587] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.404641] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.404705] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.404855] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.404935] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.405241] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.406607] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.406607] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.406607] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.406607] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.406607] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.406607] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.406607] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.406607] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.406607] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.406607] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c5e3a29-0bf9-4a6e-acfc-b7c273d94476 is going to be created. [ 874.480899] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.481084] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.481175] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.481491] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.481744] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.501206] env[65943]: INFO networking_nsxv3.common.synchronization [None req-9e36ff89-e99b-4caa-aaff-a5fa802ff501 tempest-ServerRescueNegativeTestJSON-734649129 tempest-ServerRescueNegativeTestJSON-734649129-project-member] Enqueued Resource ID: 7bf10448-5be8-4851-a7f0-5ce51163751a with Priority: HIGHEST for action security_group_rules [ 874.503418] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c5e3a29-0bf9-4a6e-acfc-b7c273d94476 in Status: IN_PROGRESS for 2s [ 874.503627] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bf10448-5be8-4851-a7f0-5ce51163751a with Priority: HIGHEST for action security_group_rules [ 874.504186] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7bf10448-5be8-4851-a7f0-5ce51163751a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.504374] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7bf10448-5be8-4851-a7f0-5ce51163751a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.608816] env[65943]: INFO networking_nsxv3.common.synchronization [req-867f63f6-6a68-4273-a6fa-5c9bec6e31e4 req-ae92a16f-125c-486e-8fac-63a7a6a4a3a6 tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_members [ 874.609817] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_members [ 874.610539] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-69913569-f584-45f7-91a4-ec8af89769a9 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.614084] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.614084] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.614084] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.614084] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.614084] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.614084] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.614084] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.614084] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.614084] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.848777] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.850177] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.850236] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.850991] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.850991] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.850991] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7bf10448-5be8-4851-a7f0-5ce51163751a already deleted. [ 874.850991] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7bf10448-5be8-4851-a7f0-5ce51163751a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.851276] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7bf10448-5be8-4851-a7f0-5ce51163751a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.851428] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7bf10448-5be8-4851-a7f0-5ce51163751a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.851558] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7bf10448-5be8-4851-a7f0-5ce51163751a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.077092] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-892 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.077321] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-892" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.077534] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-892" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.077712] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-892" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.077975] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.078146] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.078260] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.078514] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.078683] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.078896] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 875.079015] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 875.079128] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 875.079237] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 875.079347] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 875.079448] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 875.079627] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 875.099905] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 875.100181] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 875.100350] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 875.100552] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-892" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.100925] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-a72be4c2-299d-4e6d-a32c-e4e5832c4c94 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.101134] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-a72be4c2-299d-4e6d-a32c-e4e5832c4c94" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.101280] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-a72be4c2-299d-4e6d-a32c-e4e5832c4c94" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.101688] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-a72be4c2-299d-4e6d-a32c-e4e5832c4c94" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.101840] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a72be4c2-299d-4e6d-a32c-e4e5832c4c94',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.113990] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.374378] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.374782] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.374782] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.374846] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.374946] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.375078] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7bf10448-5be8-4851-a7f0-5ce51163751a already deleted. [ 875.375218] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7bf10448-5be8-4851-a7f0-5ce51163751a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.520976] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55c4b60d-641f-4044-8228-251f73d38ecb in Status: SUCCESS [ 875.521253] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.604921] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.605392] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.605681] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.606426] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.606823] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.607405] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port a72be4c2-299d-4e6d-a32c-e4e5832c4c94 not found, creating... [ 875.608115] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.608372] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.608578] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.609157] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.609522] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.610203] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.614031] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.614031] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.614031] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.614031] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.614031] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: a72be4c2-299d-4e6d-a32c-e4e5832c4c94 is going to be created. [ 875.616265] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.640154] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.640154] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.640154] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.640686] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.641335] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.641335] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-a72be4c2-299d-4e6d-a32c-e4e5832c4c94" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.119422] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.119586] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.119642] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.119847] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.119940] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.120122] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69913569-f584-45f7-91a4-ec8af89769a9 is going to be updated. [ 876.152803] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.152991] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.153061] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.153897] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.153897] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.164081] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69913569-f584-45f7-91a4-ec8af89769a9 in Status: IN_PROGRESS for 2s [ 876.228956] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d in Status: SUCCESS [ 876.229288] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.229493] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.229720] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.229950] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.230082] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.230150] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.230308] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.230602] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.230602] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.230602] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4b23ffb1-731f-42f8-bb4b-c106291be34d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.416111] env[65943]: INFO networking_nsxv3.common.synchronization [req-867f63f6-6a68-4273-a6fa-5c9bec6e31e4 req-b035785a-e2a7-42ca-a75c-a2bc70667e18 service nova] Enqueued Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_rules [ 876.419108] env[65943]: INFO networking_nsxv3.common.synchronization [req-867f63f6-6a68-4273-a6fa-5c9bec6e31e4 req-b035785a-e2a7-42ca-a75c-a2bc70667e18 service nova] Enqueued Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_members [ 876.419394] env[65943]: INFO networking_nsxv3.common.synchronization [req-867f63f6-6a68-4273-a6fa-5c9bec6e31e4 req-b035785a-e2a7-42ca-a75c-a2bc70667e18 service nova] Enqueued Resource ID: a72be4c2-299d-4e6d-a32c-e4e5832c4c94 with Priority: HIGHEST for action port [ 876.420250] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_rules [ 876.420662] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_members [ 876.420809] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a72be4c2-299d-4e6d-a32c-e4e5832c4c94 with Priority: HIGHEST for action port [ 876.421167] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69913569-f584-45f7-91a4-ec8af89769a9 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.421352] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.421455] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.422017] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.422017] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.424132] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-69913569-f584-45f7-91a4-ec8af89769a9 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.424132] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.424132] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-a72be4c2-299d-4e6d-a32c-e4e5832c4c94 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.424132] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a72be4c2-299d-4e6d-a32c-e4e5832c4c94" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.424132] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a72be4c2-299d-4e6d-a32c-e4e5832c4c94" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.424447] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a72be4c2-299d-4e6d-a32c-e4e5832c4c94" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.424447] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a72be4c2-299d-4e6d-a32c-e4e5832c4c94',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.516569] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c5e3a29-0bf9-4a6e-acfc-b7c273d94476 in Status: SUCCESS [ 876.516798] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.735841] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b23ffb1-731f-42f8-bb4b-c106291be34d taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.736044] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.736089] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.736299] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.736477] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.736766] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.736766] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.736766] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.736879] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.737305] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.737305] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b23ffb1-731f-42f8-bb4b-c106291be34d taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.737305] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.737305] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.737685] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.737685] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.737775] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.737775] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.737899] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.737989] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.738057] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.738144] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4b23ffb1-731f-42f8-bb4b-c106291be34d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.928622] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-69913569-f584-45f7-91a4-ec8af89769a9 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.928850] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.929130] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a72be4c2-299d-4e6d-a32c-e4e5832c4c94 with status ACTIVE [ 876.929324] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.929434] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.929513] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.929712] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.929802] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.929970] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.930086] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.930149] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.931829] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.931960] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.932192] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.932304] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.932386] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.932548] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.932626] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.932716] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a72be4c2-299d-4e6d-a32c-e4e5832c4c94 is going to be updated. [ 876.960732] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.960884] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.960973] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.961167] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.961303] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.961478] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a72be4c2-299d-4e6d-a32c-e4e5832c4c94" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.244816] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4b23ffb1-731f-42f8-bb4b-c106291be34d: rpc.has_security_group_logging(os_id): False [ 877.270750] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.270900] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.270969] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.271208] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.271323] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.271530] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.271636] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.271699] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.271860] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.271958] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.272231] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.272334] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.272644] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.272644] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.272644] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.276052] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.276052] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.276052] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.276751] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.276751] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.276751] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d is going to be created. [ 877.383731] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.385021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.385021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.385021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.385021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.399329] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d in Status: IN_PROGRESS for 2s [ 878.175587] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69913569-f584-45f7-91a4-ec8af89769a9 in Status: SUCCESS [ 878.175919] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.176206] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.176438] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.176669] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.176803] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.176907] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.177243] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.177374] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.177484] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.679436] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.183191] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.415669] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d in Status: SUCCESS [ 879.416046] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.685798] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.686091] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.686091] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.686387] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.686509] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.686630] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69913569-f584-45f7-91a4-ec8af89769a9 is going to be updated. [ 879.727459] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.727667] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.731035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.731035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.731035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.747528] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69913569-f584-45f7-91a4-ec8af89769a9 in Status: IN_PROGRESS for 2s [ 879.942933] env[65943]: INFO networking_nsxv3.common.synchronization [req-e48967f8-2b37-4c8e-a216-32977a2de3ce req-9979112c-a036-44be-aa60-243b4af7e248 tempest-ServersNegativeTestJSON-1424653399 tempest-ServersNegativeTestJSON-1424653399-project-member] Enqueued Resource ID: 55c4b60d-641f-4044-8228-251f73d38ecb with Priority: HIGHEST for action security_group_members [ 879.943554] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55c4b60d-641f-4044-8228-251f73d38ecb with Priority: HIGHEST for action security_group_members [ 879.943875] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-55c4b60d-641f-4044-8228-251f73d38ecb taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.944020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.944104] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.944290] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.944463] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.944569] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.944615] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.944793] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.944982] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.944982] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55c4b60d-641f-4044-8228-251f73d38ecb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.399180] env[65943]: INFO networking_nsxv3.common.synchronization [req-58a814b3-1ab0-4ca3-8a6a-9436ab6104d3 req-6c38618d-89b4-423f-9989-a04f686d0a25 tempest-ListServerFiltersTestJSON-237143396 tempest-ListServerFiltersTestJSON-237143396-project-member] Enqueued Resource ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e with Priority: HIGHEST for action security_group_members [ 880.400102] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e with Priority: HIGHEST for action security_group_members [ 880.400823] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8fad12-41c9-413e-91de-8c1ff3cf914e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.400823] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.400974] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.401209] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.401615] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.401819] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.402072] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.402633] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.402633] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.402633] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d8fad12-41c9-413e-91de-8c1ff3cf914e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.449302] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55c4b60d-641f-4044-8228-251f73d38ecb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.905820] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.905967] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.906054] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.906275] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.906361] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.906557] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.906654] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.906712] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.906925] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.906997] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.907090] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e is going to be updated. [ 880.937777] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.937988] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.937988] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.938244] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.938412] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.949082] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e in Status: IN_PROGRESS for 2s [ 880.952834] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55c4b60d-641f-4044-8228-251f73d38ecb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.139265] env[65943]: INFO networking_nsxv3.common.synchronization [req-760e0dd8-bb3e-4fc1-a1d2-16dc8da3a09f req-e4d1ad4f-d9c5-4334-93b5-2d4487327cd9 tempest-MultipleCreateTestJSON-697980507 tempest-MultipleCreateTestJSON-697980507-project-member] Enqueued Resource ID: f5a629bb-fe88-498c-a120-35da2e141a08 with Priority: HIGHEST for action security_group_members [ 881.139855] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5a629bb-fe88-498c-a120-35da2e141a08 with Priority: HIGHEST for action security_group_members [ 881.140189] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5a629bb-fe88-498c-a120-35da2e141a08 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.144222] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.144298] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.144583] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.144773] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.144876] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.144939] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.145104] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.145188] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.145287] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.458323] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.458323] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.458323] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.458323] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.458323] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.458323] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55c4b60d-641f-4044-8228-251f73d38ecb is going to be updated. [ 881.495443] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.495667] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.495754] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.496040] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.496217] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.510132] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55c4b60d-641f-4044-8228-251f73d38ecb in Status: IN_PROGRESS for 2s [ 881.596787] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-690 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.596955] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-690" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.597133] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-690" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.597543] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-690" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.598447] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.598447] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.598447] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.598447] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.598715] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.598891] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 881.599049] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 881.599169] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 881.599281] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 881.599394] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 881.599525] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 881.599832] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 881.623305] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 881.623397] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 881.623530] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 881.625030] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-690" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.625030] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-adedb302-1971-41d0-8b87-eca0a4ea1002 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.625030] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-adedb302-1971-41d0-8b87-eca0a4ea1002" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.625030] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-adedb302-1971-41d0-8b87-eca0a4ea1002" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.625030] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-adedb302-1971-41d0-8b87-eca0a4ea1002" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.625030] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adedb302-1971-41d0-8b87-eca0a4ea1002',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.648516] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.648906] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.649074] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.649428] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.649596] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.649970] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.650215] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.650399] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.650874] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.651037] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.651224] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5a629bb-fe88-498c-a120-35da2e141a08 already deleted. [ 881.651394] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.760050] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69913569-f584-45f7-91a4-ec8af89769a9 in Status: SUCCESS [ 881.760050] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.760050] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.760050] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.760050] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.760050] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.760050] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.760050] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.760050] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.760050] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.760050] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.060569] env[65943]: INFO networking_nsxv3.common.synchronization [req-666ae865-bad7-4463-b3cc-e384e6e67f79 req-e2daaf82-492a-4d4d-bfcc-a0c192b1270b tempest-ServerActionsV293TestJSON-838257534 tempest-ServerActionsV293TestJSON-838257534-project-member] Enqueued Resource ID: a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 with Priority: HIGHEST for action security_group_members [ 882.061286] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 with Priority: HIGHEST for action security_group_members [ 882.061671] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.061916] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.062054] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.062321] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.062565] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.062742] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.062854] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.063099] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.063241] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.063420] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4f83bf4-ed34-4088-a422-46a4d9e5c7e1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.130029] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.130269] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.130358] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.130637] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.130779] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.130932] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port adedb302-1971-41d0-8b87-eca0a4ea1002 not found, creating... [ 882.131224] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.131438] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.131516] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.131720] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.131858] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.132171] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.132326] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.132446] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.132708] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.132845] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.132995] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: adedb302-1971-41d0-8b87-eca0a4ea1002 is going to be created. [ 882.155443] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.155659] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.155811] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.156097] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.156391] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.156670] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-adedb302-1971-41d0-8b87-eca0a4ea1002" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.263124] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-69913569-f584-45f7-91a4-ec8af89769a9 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.263363] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.263435] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.263760] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.264228] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.264228] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.264228] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.264460] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.264585] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.264703] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.264918] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-69913569-f584-45f7-91a4-ec8af89769a9 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.265255] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.265255] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.265433] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.266098] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.266098] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.266855] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.267109] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.267230] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.267500] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.267653] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.566250] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.566577] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.566577] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.566718] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.566751] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.566934] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.567056] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.567121] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.567270] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.567391] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.567452] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 is going to be updated. [ 882.602421] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.602570] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.602649] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.602866] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.603043] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.613356] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 in Status: IN_PROGRESS for 2s [ 882.770261] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69913569-f584-45f7-91a4-ec8af89769a9: rpc.has_security_group_logging(os_id): False [ 882.799026] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.799156] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.799274] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.799567] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.799883] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.800123] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.800378] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.800497] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.800773] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.801062] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.801335] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.801517] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.801647] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.801818] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.801879] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.802127] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.802395] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.802539] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.802842] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.802842] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.803025] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69913569-f584-45f7-91a4-ec8af89769a9 is going to be updated. [ 882.904545] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.904839] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.905337] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.905626] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.905830] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.921301] env[65943]: INFO networking_nsxv3.common.synchronization [req-760e0dd8-bb3e-4fc1-a1d2-16dc8da3a09f req-b4314361-e08b-49b8-b16c-adba642ee1a6 service nova] Enqueued Resource ID: f5a629bb-fe88-498c-a120-35da2e141a08 with Priority: HIGHEST for action security_group_rules [ 882.921488] env[65943]: INFO networking_nsxv3.common.synchronization [req-760e0dd8-bb3e-4fc1-a1d2-16dc8da3a09f req-b4314361-e08b-49b8-b16c-adba642ee1a6 service nova] Enqueued Resource ID: f5a629bb-fe88-498c-a120-35da2e141a08 with Priority: HIGHEST for action security_group_members [ 882.921625] env[65943]: INFO networking_nsxv3.common.synchronization [req-760e0dd8-bb3e-4fc1-a1d2-16dc8da3a09f req-b4314361-e08b-49b8-b16c-adba642ee1a6 service nova] Enqueued Resource ID: adedb302-1971-41d0-8b87-eca0a4ea1002 with Priority: HIGHEST for action port [ 882.922572] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69913569-f584-45f7-91a4-ec8af89769a9 in Status: IN_PROGRESS for 2s [ 882.925331] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5a629bb-fe88-498c-a120-35da2e141a08 with Priority: HIGHEST for action security_group_rules [ 882.925570] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5a629bb-fe88-498c-a120-35da2e141a08 with Priority: HIGHEST for action security_group_members [ 882.925719] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adedb302-1971-41d0-8b87-eca0a4ea1002 with Priority: HIGHEST for action port [ 882.926558] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5a629bb-fe88-498c-a120-35da2e141a08 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.926726] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.926824] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.928298] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.928842] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.932350] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5a629bb-fe88-498c-a120-35da2e141a08 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.932350] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.932350] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.932350] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.932350] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.932350] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.932350] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.932350] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.932350] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.932350] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.933141] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-adedb302-1971-41d0-8b87-eca0a4ea1002 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.933239] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-adedb302-1971-41d0-8b87-eca0a4ea1002" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.933281] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-adedb302-1971-41d0-8b87-eca0a4ea1002" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.933474] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-adedb302-1971-41d0-8b87-eca0a4ea1002" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.933552] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adedb302-1971-41d0-8b87-eca0a4ea1002',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.969472] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e in Status: SUCCESS [ 882.971036] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e deletion is rescheduled due to dependency. [ 882.971036] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.433674] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.435545] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port adedb302-1971-41d0-8b87-eca0a4ea1002 with status ACTIVE [ 883.435766] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.435923] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.435996] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.436264] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.436360] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.436576] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.436825] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.436825] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.436984] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.437095] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.437296] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.437491] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.437556] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.437708] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.437784] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.437868] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: adedb302-1971-41d0-8b87-eca0a4ea1002 is going to be updated. [ 883.439046] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5a629bb-fe88-498c-a120-35da2e141a08 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.439170] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.466434] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.467660] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.467660] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.467660] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.467660] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.467660] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-adedb302-1971-41d0-8b87-eca0a4ea1002" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.524261] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55c4b60d-641f-4044-8228-251f73d38ecb in Status: SUCCESS [ 883.524261] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.941791] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.993445] env[65943]: INFO networking_nsxv3.common.synchronization [req-7063e7e1-72fb-49b0-bea3-88b028fb598b req-59cdb7d1-1d31-4302-ac35-2661094bfe07 tempest-TenantUsagesTestJSON-1768721863 tempest-TenantUsagesTestJSON-1768721863-project-member] Enqueued Resource ID: 7c5e3a29-0bf9-4a6e-acfc-b7c273d94476 with Priority: HIGHEST for action security_group_members [ 883.994218] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c5e3a29-0bf9-4a6e-acfc-b7c273d94476 with Priority: HIGHEST for action security_group_members [ 883.994663] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.994784] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.994820] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.995107] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.996040] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.996205] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.996263] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.997313] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.997313] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.997313] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c5e3a29-0bf9-4a6e-acfc-b7c273d94476',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.445214] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.445493] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.445493] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.445679] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.445826] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.446194] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5a629bb-fe88-498c-a120-35da2e141a08 is going to be created. [ 884.476048] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.476219] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.476302] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.476512] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.476668] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.490409] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5a629bb-fe88-498c-a120-35da2e141a08 in Status: UNINITIALIZED for 2s [ 884.502598] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.502598] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.502598] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.502828] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.503021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.503128] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.505679] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.505679] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.505679] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.505679] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.505679] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c5e3a29-0bf9-4a6e-acfc-b7c273d94476 is going to be updated. [ 884.552794] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.552794] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.552794] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.552794] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.552794] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.567411] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c5e3a29-0bf9-4a6e-acfc-b7c273d94476 in Status: IN_PROGRESS for 2s [ 884.623395] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 in Status: SUCCESS [ 884.623754] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 deletion is rescheduled due to dependency. [ 884.623916] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.943897] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69913569-f584-45f7-91a4-ec8af89769a9 in Status: SUCCESS [ 884.944895] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.415454] env[65943]: INFO networking_nsxv3.common.synchronization [req-1a74e9dc-96ee-4ead-af1c-5466f2454192 req-8a8dc546-4012-4d38-8d60-3dca134e87d2 tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_members [ 886.416853] env[65943]: INFO networking_nsxv3.common.synchronization [req-1a74e9dc-96ee-4ead-af1c-5466f2454192 req-8a8dc546-4012-4d38-8d60-3dca134e87d2 tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: a7ccb240-026a-47ea-ba4a-6c24118ff32f with Priority: HIGHEST for action security_group_members [ 886.417472] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_members [ 886.417624] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ccb240-026a-47ea-ba4a-6c24118ff32f with Priority: HIGHEST for action security_group_members [ 886.417900] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-69913569-f584-45f7-91a4-ec8af89769a9 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.418033] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.419591] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.419883] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.420107] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.420536] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.420651] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.420848] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.420946] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.421078] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.423527] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ccb240-026a-47ea-ba4a-6c24118ff32f taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.423672] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ccb240-026a-47ea-ba4a-6c24118ff32f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.423787] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ccb240-026a-47ea-ba4a-6c24118ff32f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.424039] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ccb240-026a-47ea-ba4a-6c24118ff32f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.424201] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.424311] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.424377] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.424539] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.424630] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.424737] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7ccb240-026a-47ea-ba4a-6c24118ff32f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.487155] env[65943]: INFO networking_nsxv3.common.synchronization [req-1a74e9dc-96ee-4ead-af1c-5466f2454192 req-8a8dc546-4012-4d38-8d60-3dca134e87d2 tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_rules [ 886.487155] env[65943]: INFO networking_nsxv3.common.synchronization [req-1a74e9dc-96ee-4ead-af1c-5466f2454192 req-8a8dc546-4012-4d38-8d60-3dca134e87d2 tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_members [ 886.487155] env[65943]: INFO networking_nsxv3.common.synchronization [req-1a74e9dc-96ee-4ead-af1c-5466f2454192 req-8a8dc546-4012-4d38-8d60-3dca134e87d2 tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: a7ccb240-026a-47ea-ba4a-6c24118ff32f with Priority: HIGHEST for action security_group_rules [ 886.487155] env[65943]: INFO networking_nsxv3.common.synchronization [req-1a74e9dc-96ee-4ead-af1c-5466f2454192 req-8a8dc546-4012-4d38-8d60-3dca134e87d2 tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: a7ccb240-026a-47ea-ba4a-6c24118ff32f with Priority: HIGHEST for action security_group_members [ 886.487155] env[65943]: INFO networking_nsxv3.common.synchronization [req-1a74e9dc-96ee-4ead-af1c-5466f2454192 req-8a8dc546-4012-4d38-8d60-3dca134e87d2 tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: a72be4c2-299d-4e6d-a32c-e4e5832c4c94 with Priority: HIGHEST for action port [ 886.487510] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_rules [ 886.487773] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ccb240-026a-47ea-ba4a-6c24118ff32f with Priority: HIGHEST for action security_group_rules [ 886.487991] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a72be4c2-299d-4e6d-a32c-e4e5832c4c94 with Priority: HIGHEST for action port [ 886.491022] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_members [ 886.491022] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ccb240-026a-47ea-ba4a-6c24118ff32f with Priority: HIGHEST for action security_group_members [ 886.491022] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69913569-f584-45f7-91a4-ec8af89769a9 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.491022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.491022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.491022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.491022] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.491022] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7ccb240-026a-47ea-ba4a-6c24118ff32f taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.491022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7ccb240-026a-47ea-ba4a-6c24118ff32f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.491022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7ccb240-026a-47ea-ba4a-6c24118ff32f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.491022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7ccb240-026a-47ea-ba4a-6c24118ff32f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.491022] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7ccb240-026a-47ea-ba4a-6c24118ff32f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.491833] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-a72be4c2-299d-4e6d-a32c-e4e5832c4c94 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.491973] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a72be4c2-299d-4e6d-a32c-e4e5832c4c94" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.492029] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a72be4c2-299d-4e6d-a32c-e4e5832c4c94" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.492201] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a72be4c2-299d-4e6d-a32c-e4e5832c4c94" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.492278] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a72be4c2-299d-4e6d-a32c-e4e5832c4c94',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.494717] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-69913569-f584-45f7-91a4-ec8af89769a9 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.494819] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.494996] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ccb240-026a-47ea-ba4a-6c24118ff32f taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.495082] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ccb240-026a-47ea-ba4a-6c24118ff32f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.506014] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5a629bb-fe88-498c-a120-35da2e141a08 in Status: SUCCESS [ 886.506241] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.506669] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.506875] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.507346] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.507511] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.507582] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.507909] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.508140] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.508265] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.508373] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.578011] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c5e3a29-0bf9-4a6e-acfc-b7c273d94476 in Status: SUCCESS [ 886.578219] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c5e3a29-0bf9-4a6e-acfc-b7c273d94476 deletion is rescheduled due to dependency. [ 886.578336] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.839485] env[65943]: INFO networking_nsxv3.common.synchronization [req-760e0dd8-bb3e-4fc1-a1d2-16dc8da3a09f req-bb7480f2-60bc-4aaf-9508-fdd7e69836d4 tempest-MultipleCreateTestJSON-697980507 tempest-MultipleCreateTestJSON-697980507-project-member] Enqueued Resource ID: f5a629bb-fe88-498c-a120-35da2e141a08 with Priority: HIGHEST for action security_group_members [ 886.839485] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5a629bb-fe88-498c-a120-35da2e141a08 with Priority: HIGHEST for action security_group_members [ 886.840239] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5a629bb-fe88-498c-a120-35da2e141a08 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.840933] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.842109] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.842109] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.842109] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.842109] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.842109] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.842109] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.842109] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.842109] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.927790] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.929289] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a7ccb240-026a-47ea-ba4a-6c24118ff32f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.996261] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ccb240-026a-47ea-ba4a-6c24118ff32f taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.999684] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ccb240-026a-47ea-ba4a-6c24118ff32f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.999684] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-69913569-f584-45f7-91a4-ec8af89769a9 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.999684] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.999684] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a72be4c2-299d-4e6d-a32c-e4e5832c4c94 with status ACTIVE [ 886.999684] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.999684] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.999684] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.999684] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.999684] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.999684] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.999684] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.999684] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.999684] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.999684] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.000221] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.000221] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.000577] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.001835] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.001976] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.002097] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a72be4c2-299d-4e6d-a32c-e4e5832c4c94 is going to be updated. [ 887.011507] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5a629bb-fe88-498c-a120-35da2e141a08 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.011693] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.032236] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.032412] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.032449] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.033040] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.033040] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.033040] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a72be4c2-299d-4e6d-a32c-e4e5832c4c94" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.313764] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-690 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.313988] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-690" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.314159] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-690" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.314473] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-690" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.314815] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.315041] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.315161] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.315490] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.315592] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.315798] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 887.315914] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 887.316042] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 887.316161] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 887.316252] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 887.316354] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 887.316484] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 887.337479] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 887.337713] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 887.337866] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 887.338021] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-690" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.338490] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-e9227148-08b3-423d-85a3-d6f112a6da4a taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.338621] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-e9227148-08b3-423d-85a3-d6f112a6da4a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.338738] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-e9227148-08b3-423d-85a3-d6f112a6da4a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.339109] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-e9227148-08b3-423d-85a3-d6f112a6da4a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.339223] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9227148-08b3-423d-85a3-d6f112a6da4a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.345366] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.432142] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.432901] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a7ccb240-026a-47ea-ba4a-6c24118ff32f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.845869] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.846194] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.846326] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.846686] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.846955] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.847145] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port e9227148-08b3-423d-85a3-d6f112a6da4a not found, creating... [ 887.847495] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.847679] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.847863] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.848188] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.848361] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.848754] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.849020] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.849190] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.849493] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.849723] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.851563] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: e9227148-08b3-423d-85a3-d6f112a6da4a is going to be created. [ 887.852964] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.882288] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.882590] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.882660] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.883135] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.883411] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.883891] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-e9227148-08b3-423d-85a3-d6f112a6da4a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.936410] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.936601] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.936694] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.936842] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.936928] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.939104] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69913569-f584-45f7-91a4-ec8af89769a9 is going to be updated. [ 887.939104] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.939104] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.939104] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.939410] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.939410] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.939460] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7ccb240-026a-47ea-ba4a-6c24118ff32f is going to be created. [ 887.999081] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.999281] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.999281] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.999498] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.999656] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.005558] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.005683] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.005744] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.005970] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.006129] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.015372] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69913569-f584-45f7-91a4-ec8af89769a9 in Status: IN_PROGRESS for 2s [ 888.019636] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7ccb240-026a-47ea-ba4a-6c24118ff32f in Status: UNINITIALIZED for 2s [ 888.358112] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.358308] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.358350] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.360952] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.360952] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.360952] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5a629bb-fe88-498c-a120-35da2e141a08 is going to be updated. [ 888.396256] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.396416] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.396508] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.396755] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.396929] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.415251] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5a629bb-fe88-498c-a120-35da2e141a08 in Status: IN_PROGRESS for 2s [ 888.670063] env[65943]: INFO networking_nsxv3.common.synchronization [req-760e0dd8-bb3e-4fc1-a1d2-16dc8da3a09f req-0e392c0a-10cb-46f0-8123-eaedb0e9a7b4 service nova] Enqueued Resource ID: f5a629bb-fe88-498c-a120-35da2e141a08 with Priority: HIGHEST for action security_group_rules [ 888.670366] env[65943]: INFO networking_nsxv3.common.synchronization [req-760e0dd8-bb3e-4fc1-a1d2-16dc8da3a09f req-0e392c0a-10cb-46f0-8123-eaedb0e9a7b4 service nova] Enqueued Resource ID: f5a629bb-fe88-498c-a120-35da2e141a08 with Priority: HIGHEST for action security_group_members [ 888.670421] env[65943]: INFO networking_nsxv3.common.synchronization [req-760e0dd8-bb3e-4fc1-a1d2-16dc8da3a09f req-0e392c0a-10cb-46f0-8123-eaedb0e9a7b4 service nova] Enqueued Resource ID: e9227148-08b3-423d-85a3-d6f112a6da4a with Priority: HIGHEST for action port [ 888.670921] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5a629bb-fe88-498c-a120-35da2e141a08 with Priority: HIGHEST for action security_group_rules [ 888.671089] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5a629bb-fe88-498c-a120-35da2e141a08 with Priority: HIGHEST for action security_group_members [ 888.671138] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9227148-08b3-423d-85a3-d6f112a6da4a with Priority: HIGHEST for action port [ 888.672105] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5a629bb-fe88-498c-a120-35da2e141a08 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.672105] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.672105] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5a629bb-fe88-498c-a120-35da2e141a08 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.672105] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.672105] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9227148-08b3-423d-85a3-d6f112a6da4a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.672351] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9227148-08b3-423d-85a3-d6f112a6da4a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.672351] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9227148-08b3-423d-85a3-d6f112a6da4a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.673038] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9227148-08b3-423d-85a3-d6f112a6da4a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.673038] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9227148-08b3-423d-85a3-d6f112a6da4a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.174607] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e9227148-08b3-423d-85a3-d6f112a6da4a with status ACTIVE [ 889.174857] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.174994] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.175123] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.175440] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.175547] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.175736] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.175834] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.175895] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.176070] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.176262] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.176322] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.176431] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.176523] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.176630] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.176702] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.176785] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e9227148-08b3-423d-85a3-d6f112a6da4a is going to be updated. [ 889.201307] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.201490] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.201541] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.201858] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.202075] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.202330] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9227148-08b3-423d-85a3-d6f112a6da4a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.026296] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69913569-f584-45f7-91a4-ec8af89769a9 in Status: SUCCESS [ 890.026582] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.026783] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.027077] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.027323] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.027548] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.027631] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.027837] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.027946] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.028734] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.030489] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7ccb240-026a-47ea-ba4a-6c24118ff32f in Status: SUCCESS [ 890.030704] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ccb240-026a-47ea-ba4a-6c24118ff32f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.030834] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ccb240-026a-47ea-ba4a-6c24118ff32f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.031029] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ccb240-026a-47ea-ba4a-6c24118ff32f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.031205] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.031333] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.031405] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.031655] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.031655] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.031738] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7ccb240-026a-47ea-ba4a-6c24118ff32f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.427731] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5a629bb-fe88-498c-a120-35da2e141a08 in Status: SUCCESS [ 890.427996] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.428208] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.428510] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.428696] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.428820] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.428887] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.429087] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.429172] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.429257] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.429501] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5a629bb-fe88-498c-a120-35da2e141a08 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.430103] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.430103] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.430103] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.430103] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.430103] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.430317] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.430317] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.430369] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.430405] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.430498] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.431396] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.431555] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.431714] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.431862] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.431933] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.432098] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.432174] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.432426] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.536307] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a7ccb240-026a-47ea-ba4a-6c24118ff32f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.537502] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.933716] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5a629bb-fe88-498c-a120-35da2e141a08: rpc.has_security_group_logging(os_id): False [ 890.934905] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.961543] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.961757] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.961865] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.962208] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.962334] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.962706] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.962873] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.962954] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.963274] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.963404] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.963681] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.963814] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.963900] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.964201] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.964248] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.964529] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.964653] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.964806] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.965019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.965131] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.965246] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5a629bb-fe88-498c-a120-35da2e141a08 is going to be created. [ 891.039454] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a7ccb240-026a-47ea-ba4a-6c24118ff32f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.041305] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.052251] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.052474] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.052583] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.052912] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.053198] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.074451] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5a629bb-fe88-498c-a120-35da2e141a08 in Status: IN_PROGRESS for 2s [ 891.438422] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.543689] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.543857] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.543964] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.544381] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.544452] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.544598] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7ccb240-026a-47ea-ba4a-6c24118ff32f is going to be updated. [ 891.546309] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.546502] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.546609] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.546917] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.546971] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.547078] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69913569-f584-45f7-91a4-ec8af89769a9 is going to be updated. [ 891.584872] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.585038] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.585113] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.585418] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.585586] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.587818] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.587988] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.587988] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.588242] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.588386] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.602542] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69913569-f584-45f7-91a4-ec8af89769a9 in Status: IN_PROGRESS for 2s [ 891.603441] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7ccb240-026a-47ea-ba4a-6c24118ff32f in Status: IN_PROGRESS for 2s [ 891.942954] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.943098] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.943098] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.944187] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.944187] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.944187] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5a629bb-fe88-498c-a120-35da2e141a08 is going to be updated. [ 891.977963] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.978193] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.978302] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.978721] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.979024] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.994533] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5a629bb-fe88-498c-a120-35da2e141a08 in Status: IN_PROGRESS for 2s [ 892.637993] env[65943]: INFO networking_nsxv3.common.synchronization [req-3ff01286-a19f-4faa-a0d7-739d5eca7e0f req-4278841e-9abe-4516-96a0-665712aae026 tempest-ServersAdminTestJSON-910281195 tempest-ServersAdminTestJSON-910281195-project-member] Enqueued Resource ID: e02be8c7-70b1-4488-b079-b1ebf20a733c with Priority: HIGHEST for action security_group_members [ 892.638592] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e02be8c7-70b1-4488-b079-b1ebf20a733c with Priority: HIGHEST for action security_group_members [ 892.638816] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e02be8c7-70b1-4488-b079-b1ebf20a733c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.638924] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.638997] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.639210] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.639364] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.639464] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.639525] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.639675] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.639755] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.639867] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.020580] env[65943]: INFO networking_nsxv3.common.synchronization [req-db40d10b-9d23-45fe-9004-c161a692a50e req-8340a0af-f276-4638-bd14-5b203a632c89 tempest-ListImageFiltersTestJSON-1963006750 tempest-ListImageFiltersTestJSON-1963006750-project-member] Enqueued Resource ID: c00c3594-d682-43fb-9d53-d5100f161d24 with Priority: HIGHEST for action security_group_members [ 893.022969] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c00c3594-d682-43fb-9d53-d5100f161d24 with Priority: HIGHEST for action security_group_members [ 893.022969] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c00c3594-d682-43fb-9d53-d5100f161d24 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.023290] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.023397] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.024159] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.024159] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.024159] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.024159] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.024159] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.024406] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.024406] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c00c3594-d682-43fb-9d53-d5100f161d24',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.088137] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5a629bb-fe88-498c-a120-35da2e141a08 in Status: SUCCESS [ 893.088137] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.089856] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.090072] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.090072] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.143680] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.143680] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.143680] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.143680] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.143680] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.143680] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.143680] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.143680] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.143680] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.143680] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.143680] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e02be8c7-70b1-4488-b079-b1ebf20a733c is going to be updated. [ 893.184267] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.184481] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.184597] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.185278] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.185480] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.196481] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e02be8c7-70b1-4488-b079-b1ebf20a733c in Status: IN_PROGRESS for 2s [ 893.267882] env[65943]: INFO networking_nsxv3.common.synchronization [req-ea326877-1efc-4077-ad36-6114a6983c05 req-f442e9f4-3b7e-4795-af8f-8637ee0aa129 tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: a7ccb240-026a-47ea-ba4a-6c24118ff32f with Priority: HIGHEST for action security_group_members [ 893.268623] env[65943]: INFO networking_nsxv3.common.synchronization [req-ea326877-1efc-4077-ad36-6114a6983c05 req-f442e9f4-3b7e-4795-af8f-8637ee0aa129 tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: ae5c5e43-4897-4526-8bcd-d56ad19b0a45 with Priority: HIGHEST for action security_group_members [ 893.268937] env[65943]: INFO networking_nsxv3.common.synchronization [req-ea326877-1efc-4077-ad36-6114a6983c05 req-f442e9f4-3b7e-4795-af8f-8637ee0aa129 tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_members [ 893.269930] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ccb240-026a-47ea-ba4a-6c24118ff32f with Priority: HIGHEST for action security_group_members [ 893.270219] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae5c5e43-4897-4526-8bcd-d56ad19b0a45 with Priority: HIGHEST for action security_group_members [ 893.270718] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_members [ 893.271099] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ccb240-026a-47ea-ba4a-6c24118ff32f taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.272585] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ccb240-026a-47ea-ba4a-6c24118ff32f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.272585] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae5c5e43-4897-4526-8bcd-d56ad19b0a45 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.272585] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae5c5e43-4897-4526-8bcd-d56ad19b0a45" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.272585] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae5c5e43-4897-4526-8bcd-d56ad19b0a45" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.273150] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae5c5e43-4897-4526-8bcd-d56ad19b0a45" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.273280] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.273378] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.273471] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.274299] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.274396] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.274489] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae5c5e43-4897-4526-8bcd-d56ad19b0a45',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.276833] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-69913569-f584-45f7-91a4-ec8af89769a9 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.276833] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.345684] env[65943]: INFO networking_nsxv3.common.synchronization [req-ea326877-1efc-4077-ad36-6114a6983c05 req-f442e9f4-3b7e-4795-af8f-8637ee0aa129 tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_rules [ 893.345926] env[65943]: INFO networking_nsxv3.common.synchronization [req-ea326877-1efc-4077-ad36-6114a6983c05 req-f442e9f4-3b7e-4795-af8f-8637ee0aa129 tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_members [ 893.346017] env[65943]: INFO networking_nsxv3.common.synchronization [req-ea326877-1efc-4077-ad36-6114a6983c05 req-f442e9f4-3b7e-4795-af8f-8637ee0aa129 tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: a7ccb240-026a-47ea-ba4a-6c24118ff32f with Priority: HIGHEST for action security_group_rules [ 893.346814] env[65943]: INFO networking_nsxv3.common.synchronization [req-ea326877-1efc-4077-ad36-6114a6983c05 req-f442e9f4-3b7e-4795-af8f-8637ee0aa129 tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: a7ccb240-026a-47ea-ba4a-6c24118ff32f with Priority: HIGHEST for action security_group_members [ 893.346814] env[65943]: INFO networking_nsxv3.common.synchronization [req-ea326877-1efc-4077-ad36-6114a6983c05 req-f442e9f4-3b7e-4795-af8f-8637ee0aa129 tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: ae5c5e43-4897-4526-8bcd-d56ad19b0a45 with Priority: HIGHEST for action security_group_rules [ 893.346814] env[65943]: INFO networking_nsxv3.common.synchronization [req-ea326877-1efc-4077-ad36-6114a6983c05 req-f442e9f4-3b7e-4795-af8f-8637ee0aa129 tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: ae5c5e43-4897-4526-8bcd-d56ad19b0a45 with Priority: HIGHEST for action security_group_members [ 893.346814] env[65943]: INFO networking_nsxv3.common.synchronization [req-ea326877-1efc-4077-ad36-6114a6983c05 req-f442e9f4-3b7e-4795-af8f-8637ee0aa129 tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: a72be4c2-299d-4e6d-a32c-e4e5832c4c94 with Priority: HIGHEST for action port [ 893.348970] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_rules [ 893.348970] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ccb240-026a-47ea-ba4a-6c24118ff32f with Priority: HIGHEST for action security_group_rules [ 893.348970] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae5c5e43-4897-4526-8bcd-d56ad19b0a45 with Priority: HIGHEST for action security_group_members [ 893.348970] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a72be4c2-299d-4e6d-a32c-e4e5832c4c94 with Priority: HIGHEST for action port [ 893.349110] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae5c5e43-4897-4526-8bcd-d56ad19b0a45 with Priority: HIGHEST for action security_group_rules [ 893.349110] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_members [ 893.349283] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ccb240-026a-47ea-ba4a-6c24118ff32f with Priority: HIGHEST for action security_group_members [ 893.351775] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69913569-f584-45f7-91a4-ec8af89769a9 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.351775] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.351775] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7ccb240-026a-47ea-ba4a-6c24118ff32f taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.351775] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7ccb240-026a-47ea-ba4a-6c24118ff32f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.351775] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae5c5e43-4897-4526-8bcd-d56ad19b0a45 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.351775] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae5c5e43-4897-4526-8bcd-d56ad19b0a45" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.351775] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-a72be4c2-299d-4e6d-a32c-e4e5832c4c94 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.351775] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a72be4c2-299d-4e6d-a32c-e4e5832c4c94" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.351775] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a72be4c2-299d-4e6d-a32c-e4e5832c4c94" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.351775] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a72be4c2-299d-4e6d-a32c-e4e5832c4c94" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.351775] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a72be4c2-299d-4e6d-a32c-e4e5832c4c94',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.351775] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae5c5e43-4897-4526-8bcd-d56ad19b0a45 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.351775] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae5c5e43-4897-4526-8bcd-d56ad19b0a45" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.351775] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae5c5e43-4897-4526-8bcd-d56ad19b0a45" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.352504] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae5c5e43-4897-4526-8bcd-d56ad19b0a45" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.352504] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae5c5e43-4897-4526-8bcd-d56ad19b0a45',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.354453] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-69913569-f584-45f7-91a4-ec8af89769a9 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.354453] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.354453] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ccb240-026a-47ea-ba4a-6c24118ff32f taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.354453] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ccb240-026a-47ea-ba4a-6c24118ff32f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.527951] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c00c3594-d682-43fb-9d53-d5100f161d24',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.594028] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5a629bb-fe88-498c-a120-35da2e141a08 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.594028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.614933] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69913569-f584-45f7-91a4-ec8af89769a9 in Status: SUCCESS [ 893.615265] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.615493] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.615700] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.615898] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.616124] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.616238] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.616436] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.616561] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.616606] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.616703] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.618863] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7ccb240-026a-47ea-ba4a-6c24118ff32f in Status: SUCCESS [ 893.619060] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ccb240-026a-47ea-ba4a-6c24118ff32f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.619207] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.619378] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.619555] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.619667] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.619726] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.619873] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.619950] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.620055] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.620878] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ccb240-026a-47ea-ba4a-6c24118ff32f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.621053] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ccb240-026a-47ea-ba4a-6c24118ff32f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.621218] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.621320] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.621384] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.621521] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.621601] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.621681] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ccb240-026a-47ea-ba4a-6c24118ff32f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.622027] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a7ccb240-026a-47ea-ba4a-6c24118ff32f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.622754] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ccb240-026a-47ea-ba4a-6c24118ff32f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.622915] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ccb240-026a-47ea-ba4a-6c24118ff32f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.623081] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.623181] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.623243] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.623382] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.623458] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.623618] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7ccb240-026a-47ea-ba4a-6c24118ff32f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.777847] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae5c5e43-4897-4526-8bcd-d56ad19b0a45',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.854812] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae5c5e43-4897-4526-8bcd-d56ad19b0a45 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.854956] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae5c5e43-4897-4526-8bcd-d56ad19b0a45" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.858659] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a72be4c2-299d-4e6d-a32c-e4e5832c4c94 with status ACTIVE [ 893.858856] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.858989] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.859080] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.859271] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.859357] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.859529] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.859640] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.859698] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.859841] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.859930] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.860108] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.860217] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.860275] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.860380] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.860449] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.860533] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a72be4c2-299d-4e6d-a32c-e4e5832c4c94 is going to be updated. [ 893.887498] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.887498] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.887736] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.887778] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.888318] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.888318] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a72be4c2-299d-4e6d-a32c-e4e5832c4c94" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.007719] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5a629bb-fe88-498c-a120-35da2e141a08 in Status: SUCCESS [ 894.008067] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.008253] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.008473] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.009426] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.009426] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.009426] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.009426] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.009426] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.009426] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.009426] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.030297] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c00c3594-d682-43fb-9d53-d5100f161d24',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.124794] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.126417] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-69913569-f584-45f7-91a4-ec8af89769a9 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.126417] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.126417] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a7ccb240-026a-47ea-ba4a-6c24118ff32f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.127706] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a7ccb240-026a-47ea-ba4a-6c24118ff32f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.280460] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae5c5e43-4897-4526-8bcd-d56ad19b0a45',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.512730] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5a629bb-fe88-498c-a120-35da2e141a08 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.512879] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.512948] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.513201] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.515018] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.515018] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.515018] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.515018] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.515018] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.515018] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.515018] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5a629bb-fe88-498c-a120-35da2e141a08 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.515018] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.515018] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.515018] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.515018] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.515018] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.515018] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.515018] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.515018] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.515018] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.515018] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.532895] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.533159] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.533266] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.533507] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.533612] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.533716] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c00c3594-d682-43fb-9d53-d5100f161d24 is going to be updated. [ 894.564697] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.564697] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.564697] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.564697] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.564697] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.574252] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c00c3594-d682-43fb-9d53-d5100f161d24 in Status: IN_PROGRESS for 2s [ 894.629375] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.631644] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a7ccb240-026a-47ea-ba4a-6c24118ff32f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.632505] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a7ccb240-026a-47ea-ba4a-6c24118ff32f: rpc.has_security_group_logging(os_id): False [ 894.651306] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.651454] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.651525] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.651736] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.651826] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.652066] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.652169] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.652235] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.652380] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.652455] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.652539] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7ccb240-026a-47ea-ba4a-6c24118ff32f is going to be created. [ 894.750146] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.750146] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.750146] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.750146] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.750413] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.769764] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7ccb240-026a-47ea-ba4a-6c24118ff32f in Status: IN_PROGRESS for 2s [ 894.784421] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.784740] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.784740] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.784839] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.784934] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.785050] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae5c5e43-4897-4526-8bcd-d56ad19b0a45 is going to be created. [ 894.789933] env[65943]: INFO networking_nsxv3.common.synchronization [None req-7d0cbeeb-87bc-49ce-a6ad-4a96028702fb tempest-ServerActionsTestOtherA-92071881 tempest-ServerActionsTestOtherA-92071881-project-member] Enqueued Resource ID: 45bb0dcc-2197-4aae-a058-937524e3408a with Priority: HIGHEST for action security_group_rules [ 894.791583] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45bb0dcc-2197-4aae-a058-937524e3408a with Priority: HIGHEST for action security_group_rules [ 894.791583] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45bb0dcc-2197-4aae-a058-937524e3408a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.791583] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45bb0dcc-2197-4aae-a058-937524e3408a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.791821] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45bb0dcc-2197-4aae-a058-937524e3408a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.791909] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45bb0dcc-2197-4aae-a058-937524e3408a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.792037] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45bb0dcc-2197-4aae-a058-937524e3408a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.823622] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.823795] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.823839] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.824116] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.825326] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.847968] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae5c5e43-4897-4526-8bcd-d56ad19b0a45 in Status: UNINITIALIZED for 2s [ 894.967198] env[65943]: INFO networking_nsxv3.common.synchronization [None req-a3b7f097-0b48-4c53-a945-20491dd0f6bd tempest-ServerActionsTestOtherA-92071881 tempest-ServerActionsTestOtherA-92071881-project-member] Enqueued Resource ID: 45bb0dcc-2197-4aae-a058-937524e3408a with Priority: HIGHEST for action security_group_rules [ 894.968730] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45bb0dcc-2197-4aae-a058-937524e3408a with Priority: HIGHEST for action security_group_rules [ 894.969179] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45bb0dcc-2197-4aae-a058-937524e3408a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.969298] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45bb0dcc-2197-4aae-a058-937524e3408a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.018518] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5a629bb-fe88-498c-a120-35da2e141a08: rpc.has_security_group_logging(os_id): False [ 895.047047] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.047218] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.047260] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.048763] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.048763] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.048763] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.048763] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.048763] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.048763] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.048763] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.048763] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.048763] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.048763] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.048763] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.048763] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.049411] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.049411] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.049411] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.049411] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.049411] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.049411] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5a629bb-fe88-498c-a120-35da2e141a08 is going to be updated. [ 895.122677] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.122894] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.122982] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.123220] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.123391] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.130665] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.130842] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.130936] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.131205] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.131299] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.131400] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69913569-f584-45f7-91a4-ec8af89769a9 is going to be updated. [ 895.135655] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.135883] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.135980] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.136131] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.136210] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.136307] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7ccb240-026a-47ea-ba4a-6c24118ff32f is going to be updated. [ 895.139607] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5a629bb-fe88-498c-a120-35da2e141a08 in Status: IN_PROGRESS for 2s [ 895.180758] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.180758] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.180977] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.181292] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.181420] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.183650] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.183819] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.184024] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.184138] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.184238] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.203227] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7ccb240-026a-47ea-ba4a-6c24118ff32f in Status: IN_PROGRESS for 2s [ 895.204825] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69913569-f584-45f7-91a4-ec8af89769a9 in Status: IN_PROGRESS for 2s [ 895.217067] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e02be8c7-70b1-4488-b079-b1ebf20a733c in Status: SUCCESS [ 895.217067] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e02be8c7-70b1-4488-b079-b1ebf20a733c deletion is rescheduled due to dependency. [ 895.217067] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.317025] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.317025] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.318615] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.318745] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.318927] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.319033] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45bb0dcc-2197-4aae-a058-937524e3408a already deleted. [ 895.319113] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45bb0dcc-2197-4aae-a058-937524e3408a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.319529] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45bb0dcc-2197-4aae-a058-937524e3408a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.319529] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45bb0dcc-2197-4aae-a058-937524e3408a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.319634] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45bb0dcc-2197-4aae-a058-937524e3408a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.844158] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.844689] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.844689] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.844689] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.844689] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.844689] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45bb0dcc-2197-4aae-a058-937524e3408a already deleted. [ 895.844822] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45bb0dcc-2197-4aae-a058-937524e3408a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.172682] env[65943]: INFO networking_nsxv3.common.synchronization [req-6cb4daf0-59d9-4b20-8621-8f754b5cc958 req-59564120-63d2-47a0-ab13-e1f4b5add190 tempest-ImagesOneServerNegativeTestJSON-477600040 tempest-ImagesOneServerNegativeTestJSON-477600040-project-member] Enqueued Resource ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d with Priority: HIGHEST for action security_group_members [ 896.173353] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d with Priority: HIGHEST for action security_group_members [ 896.173994] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b23ffb1-731f-42f8-bb4b-c106291be34d taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.173994] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.173994] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.174238] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.175055] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.175055] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.175055] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.175055] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.175055] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.175055] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b23ffb1-731f-42f8-bb4b-c106291be34d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.441552] env[65943]: INFO networking_nsxv3.common.synchronization [req-4e2bb9ef-daa9-4169-83da-24bcfae5945d req-3cbf198e-01a2-465e-acde-62ee5ebb3d32 tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_members [ 896.441710] env[65943]: INFO networking_nsxv3.common.synchronization [req-4e2bb9ef-daa9-4169-83da-24bcfae5945d req-3cbf198e-01a2-465e-acde-62ee5ebb3d32 tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: a7ccb240-026a-47ea-ba4a-6c24118ff32f with Priority: HIGHEST for action security_group_members [ 896.441842] env[65943]: INFO networking_nsxv3.common.synchronization [req-4e2bb9ef-daa9-4169-83da-24bcfae5945d req-3cbf198e-01a2-465e-acde-62ee5ebb3d32 tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: ae5c5e43-4897-4526-8bcd-d56ad19b0a45 with Priority: HIGHEST for action security_group_members [ 896.442390] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_members [ 896.442723] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ccb240-026a-47ea-ba4a-6c24118ff32f with Priority: HIGHEST for action security_group_members [ 896.442926] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae5c5e43-4897-4526-8bcd-d56ad19b0a45 with Priority: HIGHEST for action security_group_members [ 896.443336] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-69913569-f584-45f7-91a4-ec8af89769a9 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.443444] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.444136] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ccb240-026a-47ea-ba4a-6c24118ff32f taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.444136] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ccb240-026a-47ea-ba4a-6c24118ff32f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.444136] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae5c5e43-4897-4526-8bcd-d56ad19b0a45 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.444480] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae5c5e43-4897-4526-8bcd-d56ad19b0a45" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.585412] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c00c3594-d682-43fb-9d53-d5100f161d24 in Status: SUCCESS [ 896.585654] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.678444] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.681258] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.681258] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.681258] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.681258] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.681258] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.681258] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.681258] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.681258] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.681258] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.681258] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d is going to be updated. [ 896.714064] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.714064] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.714064] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.714064] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.714064] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.723134] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d in Status: IN_PROGRESS for 2s [ 896.782802] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7ccb240-026a-47ea-ba4a-6c24118ff32f in Status: SUCCESS [ 896.783038] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7ccb240-026a-47ea-ba4a-6c24118ff32f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.783210] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7ccb240-026a-47ea-ba4a-6c24118ff32f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.783428] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7ccb240-026a-47ea-ba4a-6c24118ff32f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.784140] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7ccb240-026a-47ea-ba4a-6c24118ff32f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.859891] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae5c5e43-4897-4526-8bcd-d56ad19b0a45 in Status: SUCCESS [ 896.860190] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae5c5e43-4897-4526-8bcd-d56ad19b0a45" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.862172] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae5c5e43-4897-4526-8bcd-d56ad19b0a45" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.862172] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae5c5e43-4897-4526-8bcd-d56ad19b0a45" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.862172] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.862172] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.862172] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.862172] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.862172] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.862172] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae5c5e43-4897-4526-8bcd-d56ad19b0a45',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.154664] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5a629bb-fe88-498c-a120-35da2e141a08 in Status: SUCCESS [ 897.155155] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.218948] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69913569-f584-45f7-91a4-ec8af89769a9 in Status: SUCCESS [ 897.219209] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.219383] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.219607] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.219817] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.219934] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.219999] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.220165] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.220248] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.220363] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.221822] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7ccb240-026a-47ea-ba4a-6c24118ff32f in Status: SUCCESS [ 897.222103] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ccb240-026a-47ea-ba4a-6c24118ff32f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.222271] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ccb240-026a-47ea-ba4a-6c24118ff32f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.223120] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ccb240-026a-47ea-ba4a-6c24118ff32f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.223120] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.223120] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.223120] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.223291] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.223291] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.224090] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7ccb240-026a-47ea-ba4a-6c24118ff32f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.307818] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.307968] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.308040] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.308286] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.308347] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.308493] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7ccb240-026a-47ea-ba4a-6c24118ff32f is going to be deleted. [ 897.363616] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.363781] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.363853] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.364097] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.364190] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.364619] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.364619] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.364619] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.364752] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.364752] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.364807] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae5c5e43-4897-4526-8bcd-d56ad19b0a45 is going to be deleted. [ 897.378125] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.378294] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.378390] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.378593] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.378690] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.378801] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7ccb240-026a-47ea-ba4a-6c24118ff32f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.397769] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.398100] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.398100] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.398352] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.398402] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.398518] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae5c5e43-4897-4526-8bcd-d56ad19b0a45" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.398706] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae5c5e43-4897-4526-8bcd-d56ad19b0a45" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.398869] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae5c5e43-4897-4526-8bcd-d56ad19b0a45" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.399060] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.399158] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.399228] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.399383] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.399461] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.399551] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae5c5e43-4897-4526-8bcd-d56ad19b0a45',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.725109] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.726235] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.726361] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.726438] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.726688] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.726734] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.727729] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.727729] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.727729] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.727729] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.727729] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.727729] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7ccb240-026a-47ea-ba4a-6c24118ff32f is going to be deleted. [ 897.762176] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.762345] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.762405] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.762634] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.762729] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.762830] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ccb240-026a-47ea-ba4a-6c24118ff32f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.762988] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ccb240-026a-47ea-ba4a-6c24118ff32f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.763158] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ccb240-026a-47ea-ba4a-6c24118ff32f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.763324] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.763423] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.763484] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.763625] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.763703] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.763795] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7ccb240-026a-47ea-ba4a-6c24118ff32f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.902095] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.902408] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.902408] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.902674] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.902967] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.902967] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.903084] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.903167] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.903301] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.903376] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.903460] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae5c5e43-4897-4526-8bcd-d56ad19b0a45 already deleted. [ 897.903540] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae5c5e43-4897-4526-8bcd-d56ad19b0a45" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.903670] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ae5c5e43-4897-4526-8bcd-d56ad19b0a45',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.906058] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae5c5e43-4897-4526-8bcd-d56ad19b0a45" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.906058] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae5c5e43-4897-4526-8bcd-d56ad19b0a45" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.906058] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.906058] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.906058] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.906058] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.906058] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.906058] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae5c5e43-4897-4526-8bcd-d56ad19b0a45',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.229734] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.267141] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.267668] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.267668] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.268067] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.268255] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.268622] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.268802] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.268920] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.269244] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.269407] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.269568] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7ccb240-026a-47ea-ba4a-6c24118ff32f already deleted. [ 898.269784] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ccb240-026a-47ea-ba4a-6c24118ff32f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.409215] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ae5c5e43-4897-4526-8bcd-d56ad19b0a45',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.410055] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.410055] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.410055] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.410181] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.410261] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.410467] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.410569] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.410631] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.410777] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.410847] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.410925] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae5c5e43-4897-4526-8bcd-d56ad19b0a45 already deleted. [ 898.410998] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae5c5e43-4897-4526-8bcd-d56ad19b0a45" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.733184] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.733763] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.733763] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.733763] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.733763] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.733985] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69913569-f584-45f7-91a4-ec8af89769a9 is going to be updated. [ 898.736299] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d in Status: SUCCESS [ 898.736299] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d deletion is rescheduled due to dependency. [ 898.736299] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.766967] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.767174] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.767228] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.768096] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.768096] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.779356] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69913569-f584-45f7-91a4-ec8af89769a9 in Status: IN_PROGRESS for 2s [ 898.912197] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ae5c5e43-4897-4526-8bcd-d56ad19b0a45: rpc.has_security_group_logging(os_id): False [ 898.931073] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.931218] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.931285] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.931501] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.932220] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.932220] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.932220] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.932220] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.932398] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.932545] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.932916] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae5c5e43-4897-4526-8bcd-d56ad19b0a45 is going to be created. [ 898.951204] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/ae5c5e43-4897-4526-8bcd-d56ad19b0a45], does not exist path=[/infra/domains/default/groups/ae5c5e43-4897-4526-8bcd-d56ad19b0a45]."\n}' [ 898.951371] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae5c5e43-4897-4526-8bcd-d56ad19b0a45 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ae5c5e43-4897-4526-8bcd-d56ad19b0a45 [ 898.951454] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 898.988059] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.988221] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.988292] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.988562] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.989801] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.990149] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.990261] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.990261] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.990449] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.990519] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.991988] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.991988] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.991988] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.991988] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.991988] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.991988] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae5c5e43-4897-4526-8bcd-d56ad19b0a45 is going to be created. [ 899.010533] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/ae5c5e43-4897-4526-8bcd-d56ad19b0a45], does not exist path=[/infra/domains/default/groups/ae5c5e43-4897-4526-8bcd-d56ad19b0a45]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ae5c5e43-4897-4526-8bcd-d56ad19b0a45 [ 899.010678] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae5c5e43-4897-4526-8bcd-d56ad19b0a45" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.011394] env[65943]: Traceback (most recent call last): [ 899.011394] env[65943]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 899.011394] env[65943]: return func(*args, **kwargs) [ 899.011394] env[65943]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 899.011394] env[65943]: res.raise_for_status() [ 899.011394] env[65943]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 899.011394] env[65943]: raise HTTPError(http_error_msg, response=self) [ 899.011394] env[65943]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ae5c5e43-4897-4526-8bcd-d56ad19b0a45 [ 899.011394] env[65943]: During handling of the above exception, another exception occurred: [ 899.011394] env[65943]: Traceback (most recent call last): [ 899.011394] env[65943]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 899.011394] env[65943]: listener.cb(fileno) [ 899.011394] env[65943]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 899.011394] env[65943]: result = function(*args, **kwargs) [ 899.011394] env[65943]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 899.011394] env[65943]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 899.011394] env[65943]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 899.011394] env[65943]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 899.011394] env[65943]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 899.011394] env[65943]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 899.011394] env[65943]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 899.011394] env[65943]: res.raise_for_status() [ 899.011394] env[65943]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 899.011394] env[65943]: raise HTTPError(http_error_msg, response=self) [ 899.011394] env[65943]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ae5c5e43-4897-4526-8bcd-d56ad19b0a45 [ 899.011394] env[65943]: Removing descriptor: 62 [ 899.464780] env[65943]: INFO networking_nsxv3.common.synchronization [req-3a342d77-bb76-40f6-83d8-a94e3aeb68fe req-1ca3daff-0430-4513-9ee7-641ed53080ba tempest-MultipleCreateTestJSON-697980507 tempest-MultipleCreateTestJSON-697980507-project-member] Enqueued Resource ID: f5a629bb-fe88-498c-a120-35da2e141a08 with Priority: HIGHEST for action security_group_members [ 899.465513] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5a629bb-fe88-498c-a120-35da2e141a08 with Priority: HIGHEST for action security_group_members [ 899.465845] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5a629bb-fe88-498c-a120-35da2e141a08 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.465970] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.466082] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.466328] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.466577] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.466647] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.466741] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.466932] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.467060] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.467184] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.546499] env[65943]: INFO networking_nsxv3.common.synchronization [req-edae3d1c-9482-40b8-bd7f-01b5a297d32e req-91e714b0-2530-4db8-ae8d-e4598f420004 tempest-MultipleCreateTestJSON-697980507 tempest-MultipleCreateTestJSON-697980507-project-member] Enqueued Resource ID: f5a629bb-fe88-498c-a120-35da2e141a08 with Priority: HIGHEST for action security_group_members [ 899.547091] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5a629bb-fe88-498c-a120-35da2e141a08 with Priority: HIGHEST for action security_group_members [ 899.547430] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5a629bb-fe88-498c-a120-35da2e141a08 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.547556] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.969584] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.471763] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.789182] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69913569-f584-45f7-91a4-ec8af89769a9 in Status: SUCCESS [ 900.789452] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.789625] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.789848] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.790060] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.790223] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.790280] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.790555] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.790651] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.790743] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.790924] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-69913569-f584-45f7-91a4-ec8af89769a9 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.791050] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.791124] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.791295] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.791450] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.791545] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.791600] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.791736] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.791812] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.791883] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.791967] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.793486] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.793656] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.793802] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.793907] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.794477] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.794477] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.794477] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.794477] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.974217] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.974492] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.974492] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.974663] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.974751] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.974850] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5a629bb-fe88-498c-a120-35da2e141a08 is going to be updated. [ 901.005106] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.005106] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.005106] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.005106] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.005106] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.014061] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5a629bb-fe88-498c-a120-35da2e141a08 in Status: IN_PROGRESS for 2s [ 901.294197] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69913569-f584-45f7-91a4-ec8af89769a9: rpc.has_security_group_logging(os_id): False [ 901.295598] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.313341] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.314020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.314020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.314020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.318815] env[65943]: INFO networking_nsxv3.common.synchronization [req-372535b8-f324-4e33-a305-16c15c5d588b req-65be7732-5b6a-428c-b2e8-fca83476e684 tempest-MigrationsAdminTest-607423609 tempest-MigrationsAdminTest-607423609-project-member] Enqueued Resource ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a with Priority: HIGHEST for action security_group_members [ 901.318815] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a with Priority: HIGHEST for action security_group_members [ 901.319120] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.319226] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.319292] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.319674] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.319864] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.319966] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.320042] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.320198] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.320288] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.320380] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.332830] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.333124] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.333253] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.333308] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.333493] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.333577] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.334138] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.334138] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.334138] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.334138] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.334138] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.334338] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.334392] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.334508] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.334578] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.334719] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.334791] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69913569-f584-45f7-91a4-ec8af89769a9 is going to be updated. [ 901.398695] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.398695] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.398695] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.398975] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.399063] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.423203] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69913569-f584-45f7-91a4-ec8af89769a9 in Status: IN_PROGRESS for 2s [ 901.729613] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-651 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.729839] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.729950] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.730218] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.730569] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.730668] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.730744] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.730996] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.731094] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.731310] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 901.731418] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 901.731525] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 901.731633] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 901.731740] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 901.731848] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 901.732023] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 901.753524] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 901.753731] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 901.754102] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 901.754102] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-651" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.754350] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-049246f6-1556-457a-a80c-94f30c0a6b06 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.754521] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-049246f6-1556-457a-a80c-94f30c0a6b06" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.754665] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-049246f6-1556-457a-a80c-94f30c0a6b06" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.754965] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-049246f6-1556-457a-a80c-94f30c0a6b06" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.755123] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('049246f6-1556-457a-a80c-94f30c0a6b06',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.797395] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.822798] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.257163] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.257593] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.257593] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.257863] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.258040] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.258300] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port 049246f6-1556-457a-a80c-94f30c0a6b06 not found, creating... [ 902.258607] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.258732] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.258835] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.259059] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.259195] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.259474] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.259626] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.259742] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.259935] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.264165] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.264380] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: 049246f6-1556-457a-a80c-94f30c0a6b06 is going to be created. [ 902.285084] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.285084] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.285330] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.285511] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.285791] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.286132] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-049246f6-1556-457a-a80c-94f30c0a6b06" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.299588] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.299793] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.299865] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.300184] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.300335] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.300465] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69913569-f584-45f7-91a4-ec8af89769a9 is going to be updated. [ 902.324674] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.333935] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.334107] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.334218] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.334413] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.334582] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.345394] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69913569-f584-45f7-91a4-ec8af89769a9 in Status: IN_PROGRESS for 2s [ 902.827787] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.827940] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.828019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.828242] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.828334] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.828431] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a is going to be updated. [ 902.859565] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.859730] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.859773] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.860084] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.860237] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.869992] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a in Status: IN_PROGRESS for 2s [ 903.006983] env[65943]: INFO networking_nsxv3.common.synchronization [req-372535b8-f324-4e33-a305-16c15c5d588b req-d83cbe45-d76f-4322-8ebf-177b53d24d02 service nova] Enqueued Resource ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a with Priority: HIGHEST for action security_group_rules [ 903.007094] env[65943]: INFO networking_nsxv3.common.synchronization [req-372535b8-f324-4e33-a305-16c15c5d588b req-d83cbe45-d76f-4322-8ebf-177b53d24d02 service nova] Enqueued Resource ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a with Priority: HIGHEST for action security_group_members [ 903.008251] env[65943]: INFO networking_nsxv3.common.synchronization [req-372535b8-f324-4e33-a305-16c15c5d588b req-d83cbe45-d76f-4322-8ebf-177b53d24d02 service nova] Enqueued Resource ID: 049246f6-1556-457a-a80c-94f30c0a6b06 with Priority: HIGHEST for action port [ 903.008251] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a with Priority: HIGHEST for action security_group_rules [ 903.008251] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a with Priority: HIGHEST for action security_group_members [ 903.008251] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 049246f6-1556-457a-a80c-94f30c0a6b06 with Priority: HIGHEST for action port [ 903.008484] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.008616] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.008666] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.008870] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.008997] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.009805] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.009921] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.010211] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-049246f6-1556-457a-a80c-94f30c0a6b06 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.010358] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-049246f6-1556-457a-a80c-94f30c0a6b06" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.010464] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-049246f6-1556-457a-a80c-94f30c0a6b06" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.010652] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-049246f6-1556-457a-a80c-94f30c0a6b06" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.010730] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('049246f6-1556-457a-a80c-94f30c0a6b06',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.024963] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5a629bb-fe88-498c-a120-35da2e141a08 in Status: SUCCESS [ 903.024963] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.025774] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.025774] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.026633] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.026633] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.026633] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.026633] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.026633] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.026633] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.452855] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69913569-f584-45f7-91a4-ec8af89769a9 in Status: SUCCESS [ 903.452855] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.452855] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.452855] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.452855] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.512709] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.512874] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.515873] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 049246f6-1556-457a-a80c-94f30c0a6b06 with status ACTIVE [ 903.515873] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.515873] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.515873] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.515873] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.515873] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.515873] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.515873] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.515873] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.515873] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.515873] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.515873] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.515873] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.516689] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.516689] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.516689] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.516689] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 049246f6-1556-457a-a80c-94f30c0a6b06 is going to be updated. [ 903.529330] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.529896] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.529896] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.529896] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.543597] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.543982] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.543982] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.544062] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.544152] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.544336] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-049246f6-1556-457a-a80c-94f30c0a6b06" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.556210] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.556466] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.556570] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.556631] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.556831] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.557291] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.557291] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5a629bb-fe88-498c-a120-35da2e141a08 is going to be updated. [ 903.587347] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.587347] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.587347] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.587664] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.587664] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.597748] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5a629bb-fe88-498c-a120-35da2e141a08 in Status: IN_PROGRESS for 2s [ 903.956241] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-69913569-f584-45f7-91a4-ec8af89769a9 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.956241] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.012133] env[65943]: INFO networking_nsxv3.common.synchronization [req-90397a28-bf0d-453b-8c63-f1f63c884448 req-d7e466cc-8765-4269-adb4-a2a2062cd49e tempest-ServerRescueTestJSONUnderV235-819256366 tempest-ServerRescueTestJSONUnderV235-819256366-project-member] Enqueued Resource ID: 49023ece-127e-45b7-853d-a7309ff27819 with Priority: HIGHEST for action security_group_members [ 904.012640] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49023ece-127e-45b7-853d-a7309ff27819 with Priority: HIGHEST for action security_group_members [ 904.013016] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-49023ece-127e-45b7-853d-a7309ff27819 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.013327] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.013397] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.013762] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.013896] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.013996] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.014072] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.014225] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.014312] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.014405] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49023ece-127e-45b7-853d-a7309ff27819',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.356363] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69913569-f584-45f7-91a4-ec8af89769a9 in Status: SUCCESS [ 904.356534] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.356665] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.356940] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.357223] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.357362] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.357434] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.357661] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.357756] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.357860] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.357955] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.517930] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.518215] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.518215] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.518509] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.518636] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.518872] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.519250] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.519383] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.522513] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.522513] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.522513] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49023ece-127e-45b7-853d-a7309ff27819 already deleted. [ 904.522513] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.564971] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-33 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.565186] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-33" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.565634] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-33" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.565704] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-33" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.566143] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.566143] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.566271] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.566667] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.566667] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.566750] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 904.566851] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 904.566997] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 904.567070] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 904.567178] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 904.567280] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 904.568072] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 904.586764] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 904.586939] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 904.587090] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 904.587265] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-33" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.587622] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-f20016b3-cfc1-4147-bd55-2db4e8a030d0 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.587808] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-f20016b3-cfc1-4147-bd55-2db4e8a030d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.588058] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-f20016b3-cfc1-4147-bd55-2db4e8a030d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.588384] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-f20016b3-cfc1-4147-bd55-2db4e8a030d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.588528] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f20016b3-cfc1-4147-bd55-2db4e8a030d0',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.861520] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-69913569-f584-45f7-91a4-ec8af89769a9 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.861706] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.861813] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.862060] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.862228] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.862329] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.862394] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.862575] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.863831] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.863919] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.864091] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-69913569-f584-45f7-91a4-ec8af89769a9 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.864213] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.864294] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.864398] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.864563] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.864671] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.864749] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.864897] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.864976] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.865070] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.865160] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.879967] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a in Status: SUCCESS [ 904.880198] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.881417] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.881417] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.881417] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.881417] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.881417] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.881417] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.881904] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.881904] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.090851] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.091227] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.091227] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.091494] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.091638] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.091793] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port f20016b3-cfc1-4147-bd55-2db4e8a030d0 not found, creating... [ 905.092075] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.092332] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.092438] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.092981] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.094215] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.094215] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.094215] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.094215] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.094679] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.094856] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.095180] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: f20016b3-cfc1-4147-bd55-2db4e8a030d0 is going to be created. [ 905.117291] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.117606] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.117673] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.118296] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.118539] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.118774] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-f20016b3-cfc1-4147-bd55-2db4e8a030d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.368248] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69913569-f584-45f7-91a4-ec8af89769a9: rpc.has_security_group_logging(os_id): False [ 905.384047] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.387658] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.387658] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.387808] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.388348] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.388348] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.388491] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.388610] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.388677] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.389342] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.389342] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.389342] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.389342] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.389342] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.389606] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.389606] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.389666] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.389969] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.389969] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.389969] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.391698] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.391698] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69913569-f584-45f7-91a4-ec8af89769a9 is going to be updated. [ 905.456834] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.457364] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.457473] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.457834] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.458038] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.488573] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69913569-f584-45f7-91a4-ec8af89769a9 in Status: IN_PROGRESS for 2s [ 905.608940] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5a629bb-fe88-498c-a120-35da2e141a08 in Status: SUCCESS [ 905.609232] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5a629bb-fe88-498c-a120-35da2e141a08 deletion is rescheduled due to dependency. [ 905.609272] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.879651] env[65943]: INFO networking_nsxv3.common.synchronization [req-90397a28-bf0d-453b-8c63-f1f63c884448 req-a1d1263c-5bc2-4128-8fec-ff3a628c0364 service nova] Enqueued Resource ID: 49023ece-127e-45b7-853d-a7309ff27819 with Priority: HIGHEST for action security_group_rules [ 905.879807] env[65943]: INFO networking_nsxv3.common.synchronization [req-90397a28-bf0d-453b-8c63-f1f63c884448 req-a1d1263c-5bc2-4128-8fec-ff3a628c0364 service nova] Enqueued Resource ID: 49023ece-127e-45b7-853d-a7309ff27819 with Priority: HIGHEST for action security_group_members [ 905.879961] env[65943]: INFO networking_nsxv3.common.synchronization [req-90397a28-bf0d-453b-8c63-f1f63c884448 req-a1d1263c-5bc2-4128-8fec-ff3a628c0364 service nova] Enqueued Resource ID: f20016b3-cfc1-4147-bd55-2db4e8a030d0 with Priority: HIGHEST for action port [ 905.880476] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49023ece-127e-45b7-853d-a7309ff27819 with Priority: HIGHEST for action security_group_rules [ 905.880606] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49023ece-127e-45b7-853d-a7309ff27819 with Priority: HIGHEST for action security_group_members [ 905.880702] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f20016b3-cfc1-4147-bd55-2db4e8a030d0 with Priority: HIGHEST for action port [ 905.880969] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49023ece-127e-45b7-853d-a7309ff27819 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.881103] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.881168] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.881423] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.881508] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49023ece-127e-45b7-853d-a7309ff27819',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.882363] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-49023ece-127e-45b7-853d-a7309ff27819 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.883118] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.883118] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.883118] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.883118] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.883118] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.883118] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.883118] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.883468] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.883501] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49023ece-127e-45b7-853d-a7309ff27819',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.884317] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-f20016b3-cfc1-4147-bd55-2db4e8a030d0 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.884870] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f20016b3-cfc1-4147-bd55-2db4e8a030d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.884870] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f20016b3-cfc1-4147-bd55-2db4e8a030d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.884870] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f20016b3-cfc1-4147-bd55-2db4e8a030d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.884870] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f20016b3-cfc1-4147-bd55-2db4e8a030d0',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.886383] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.390023] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49023ece-127e-45b7-853d-a7309ff27819',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.390023] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-49023ece-127e-45b7-853d-a7309ff27819 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.390023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.390023] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f20016b3-cfc1-4147-bd55-2db4e8a030d0 with status ACTIVE [ 906.390023] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.390023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.390023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.390023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.390023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.390023] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.390023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.390023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.390023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.390023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.390775] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.392196] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.392411] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.394668] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.394668] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.394668] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f20016b3-cfc1-4147-bd55-2db4e8a030d0 is going to be updated. [ 906.395914] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.396416] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.396726] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.398152] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.398152] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.398152] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a is going to be updated. [ 906.421105] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.421105] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.421105] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.421105] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.421105] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.421105] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f20016b3-cfc1-4147-bd55-2db4e8a030d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.439014] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.439014] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.439014] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.439014] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.439014] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.451698] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a in Status: IN_PROGRESS for 2s [ 906.889456] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49023ece-127e-45b7-853d-a7309ff27819',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.094644] env[65943]: INFO networking_nsxv3.common.synchronization [req-4c62aa27-1de6-4140-9a02-1ba9ff0d211b req-115f0793-31e7-4bd1-99b8-7070161bac52 tempest-ServerRescueNegativeTestJSON-734649129 tempest-ServerRescueNegativeTestJSON-734649129-project-member] Enqueued Resource ID: 7bf10448-5be8-4851-a7f0-5ce51163751a with Priority: HIGHEST for action security_group_members [ 907.095244] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bf10448-5be8-4851-a7f0-5ce51163751a with Priority: HIGHEST for action security_group_members [ 907.095624] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bf10448-5be8-4851-a7f0-5ce51163751a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.095770] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bf10448-5be8-4851-a7f0-5ce51163751a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.095847] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bf10448-5be8-4851-a7f0-5ce51163751a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.096839] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bf10448-5be8-4851-a7f0-5ce51163751a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.096839] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.096839] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.096839] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.096990] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.097027] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.097119] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bf10448-5be8-4851-a7f0-5ce51163751a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.392817] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.393120] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.393120] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.393283] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.393376] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.393476] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49023ece-127e-45b7-853d-a7309ff27819 is going to be created. [ 907.421484] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.421670] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.421712] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.421931] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.422110] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.434544] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49023ece-127e-45b7-853d-a7309ff27819 in Status: UNINITIALIZED for 2s [ 907.510169] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69913569-f584-45f7-91a4-ec8af89769a9 in Status: SUCCESS [ 907.510379] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.600231] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.600423] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.600468] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.600671] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.600765] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.600959] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.601074] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.601134] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.601279] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.601351] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.601431] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bf10448-5be8-4851-a7f0-5ce51163751a already deleted. [ 907.601640] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bf10448-5be8-4851-a7f0-5ce51163751a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.672025] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-982 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.672241] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-982" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.672368] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-982" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.672654] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-982" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.672918] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.673092] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.673210] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.673514] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.673714] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.673922] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 907.674009] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 907.674131] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 907.674243] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 907.674356] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 907.674462] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 907.674596] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 907.696675] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 907.696845] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 907.696981] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 907.697172] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-982" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.697491] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-c4d59682-37c9-432d-9854-c6d1f6bcaed1 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.697921] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-c4d59682-37c9-432d-9854-c6d1f6bcaed1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.698008] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-c4d59682-37c9-432d-9854-c6d1f6bcaed1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.698349] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-c4d59682-37c9-432d-9854-c6d1f6bcaed1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.698467] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4d59682-37c9-432d-9854-c6d1f6bcaed1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.201276] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.201933] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.201933] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.201933] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.202067] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.202196] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port c4d59682-37c9-432d-9854-c6d1f6bcaed1 not found, creating... [ 908.202518] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.203307] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.203307] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.203307] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.203307] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.203577] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.203692] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.203738] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.203946] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.204911] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.207807] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: c4d59682-37c9-432d-9854-c6d1f6bcaed1 is going to be created. [ 908.234571] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.235701] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.235701] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.235701] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.235701] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.236075] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-c4d59682-37c9-432d-9854-c6d1f6bcaed1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.467473] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a in Status: SUCCESS [ 908.468453] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.468850] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.469220] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.469673] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.469872] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.469995] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.470266] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.470514] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.470623] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.470922] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.974231] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.974407] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.974509] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.974807] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.975052] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.975200] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.975298] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.976014] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.976014] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.976014] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.976014] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.976191] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.976223] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.976416] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.976611] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.976858] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.976858] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.977275] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.977371] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.977481] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.977574] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.998981] env[65943]: INFO networking_nsxv3.common.synchronization [req-4c62aa27-1de6-4140-9a02-1ba9ff0d211b req-a29ee262-48f1-4d19-963e-92b062429aac service nova] Enqueued Resource ID: 7bf10448-5be8-4851-a7f0-5ce51163751a with Priority: HIGHEST for action security_group_rules [ 908.999227] env[65943]: INFO networking_nsxv3.common.synchronization [req-4c62aa27-1de6-4140-9a02-1ba9ff0d211b req-a29ee262-48f1-4d19-963e-92b062429aac service nova] Enqueued Resource ID: 7bf10448-5be8-4851-a7f0-5ce51163751a with Priority: HIGHEST for action security_group_members [ 908.999385] env[65943]: INFO networking_nsxv3.common.synchronization [req-4c62aa27-1de6-4140-9a02-1ba9ff0d211b req-a29ee262-48f1-4d19-963e-92b062429aac service nova] Enqueued Resource ID: c4d59682-37c9-432d-9854-c6d1f6bcaed1 with Priority: HIGHEST for action port [ 909.000210] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bf10448-5be8-4851-a7f0-5ce51163751a with Priority: HIGHEST for action security_group_rules [ 909.000353] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bf10448-5be8-4851-a7f0-5ce51163751a with Priority: HIGHEST for action security_group_members [ 909.000512] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4d59682-37c9-432d-9854-c6d1f6bcaed1 with Priority: HIGHEST for action port [ 909.001135] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7bf10448-5be8-4851-a7f0-5ce51163751a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.001135] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7bf10448-5be8-4851-a7f0-5ce51163751a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.001135] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7bf10448-5be8-4851-a7f0-5ce51163751a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.001301] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7bf10448-5be8-4851-a7f0-5ce51163751a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.002163] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7bf10448-5be8-4851-a7f0-5ce51163751a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.003094] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bf10448-5be8-4851-a7f0-5ce51163751a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.003192] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bf10448-5be8-4851-a7f0-5ce51163751a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.003259] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bf10448-5be8-4851-a7f0-5ce51163751a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.003751] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bf10448-5be8-4851-a7f0-5ce51163751a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.003751] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.003751] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.003903] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.003903] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.003993] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.004115] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bf10448-5be8-4851-a7f0-5ce51163751a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.005385] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4d59682-37c9-432d-9854-c6d1f6bcaed1 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.005514] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4d59682-37c9-432d-9854-c6d1f6bcaed1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.005583] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4d59682-37c9-432d-9854-c6d1f6bcaed1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.006165] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4d59682-37c9-432d-9854-c6d1f6bcaed1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.006239] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4d59682-37c9-432d-9854-c6d1f6bcaed1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.447899] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49023ece-127e-45b7-853d-a7309ff27819 in Status: SUCCESS [ 909.448224] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.448358] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.448567] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.448799] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.448948] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.449022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.449168] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.449243] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.449331] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.449423] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49023ece-127e-45b7-853d-a7309ff27819',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.481296] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a: rpc.has_security_group_logging(os_id): False [ 909.500246] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.500415] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.500453] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.500669] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.511461] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bf10448-5be8-4851-a7f0-5ce51163751a taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.511714] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bf10448-5be8-4851-a7f0-5ce51163751a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.511951] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7bf10448-5be8-4851-a7f0-5ce51163751a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.513052] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c4d59682-37c9-432d-9854-c6d1f6bcaed1 with status ACTIVE [ 909.513288] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.513435] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.513506] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.513800] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.513893] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.514107] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.514239] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.514331] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.514520] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.514614] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.515184] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.515184] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.515184] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.515835] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.515975] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.516356] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c4d59682-37c9-432d-9854-c6d1f6bcaed1 is going to be updated. [ 909.523017] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.523017] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.523017] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.523017] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.523017] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.523017] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.523017] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.523017] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.523017] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.523017] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.523017] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.523017] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.523017] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.523017] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.523545] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.523545] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.523545] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a is going to be updated. [ 909.540713] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.540875] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.540911] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.543028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.543028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.543028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4d59682-37c9-432d-9854-c6d1f6bcaed1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.613796] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.614046] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.614046] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.614261] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.614419] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.629189] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a in Status: IN_PROGRESS for 2s [ 909.952441] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-49023ece-127e-45b7-853d-a7309ff27819 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.952689] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.952792] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.953023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.953197] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.953300] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.953558] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.953731] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.953817] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.953907] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.954071] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-49023ece-127e-45b7-853d-a7309ff27819 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.954167] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.954228] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.954399] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.954507] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.954600] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.954660] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.954792] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.954865] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.954956] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.955051] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49023ece-127e-45b7-853d-a7309ff27819',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.018756] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7bf10448-5be8-4851-a7f0-5ce51163751a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.457399] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49023ece-127e-45b7-853d-a7309ff27819: rpc.has_security_group_logging(os_id): False [ 910.479978] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.480187] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.480187] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.480383] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.480470] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.480613] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.480739] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.480838] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.480969] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.481116] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.481419] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.481561] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.481793] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.483194] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.483194] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.483409] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.483519] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.483584] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.483744] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.483828] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.483916] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49023ece-127e-45b7-853d-a7309ff27819 is going to be created. [ 910.512838] env[65943]: INFO networking_nsxv3.common.synchronization [None req-57b34061-46b9-4939-968c-9d76757583e8 None None] Enqueued Resource ID: 7625f5d1-5733-4fe1-a87d-94fe745f4a89 with Priority: HIGHEST for action port [ 910.513511] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7625f5d1-5733-4fe1-a87d-94fe745f4a89 with Priority: HIGHEST for action port [ 910.513836] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-7625f5d1-5733-4fe1-a87d-94fe745f4a89 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.514085] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7625f5d1-5733-4fe1-a87d-94fe745f4a89" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.514147] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7625f5d1-5733-4fe1-a87d-94fe745f4a89" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.514417] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7625f5d1-5733-4fe1-a87d-94fe745f4a89" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.514505] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7625f5d1-5733-4fe1-a87d-94fe745f4a89',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.523052] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.523297] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.523408] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.523718] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.523862] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.524055] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bf10448-5be8-4851-a7f0-5ce51163751a is going to be created. [ 910.553181] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.553429] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.553429] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.553699] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.553947] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.564249] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.564499] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.564603] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.564904] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.565400] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.575571] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bf10448-5be8-4851-a7f0-5ce51163751a in Status: UNINITIALIZED for 2s [ 910.582779] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49023ece-127e-45b7-853d-a7309ff27819 in Status: IN_PROGRESS for 2s [ 911.017459] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7625f5d1-5733-4fe1-a87d-94fe745f4a89 [ 911.017459] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.017459] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.017459] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.017459] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.017459] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.017459] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7625f5d1-5733-4fe1-a87d-94fe745f4a89 already deleted. [ 911.017459] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7625f5d1-5733-4fe1-a87d-94fe745f4a89" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.643074] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a in Status: SUCCESS [ 911.643370] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.680020] env[65943]: INFO networking_nsxv3.common.synchronization [req-bed84b36-0335-4563-9afc-fb3b81cf90d1 req-a60ac9d8-bc8e-4b34-a98e-d0d2919bb847 tempest-DeleteServersTestJSON-1404918926 tempest-DeleteServersTestJSON-1404918926-project-member] Enqueued Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_members [ 911.680020] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_members [ 911.680020] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.680020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.680020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.680464] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.680784] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.681046] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.681226] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.681611] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.681832] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.682086] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.186375] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.186619] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.186619] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.186838] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.211145] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.211477] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.211636] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.211726] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.211944] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.212063] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.212187] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 is going to be updated. [ 912.261034] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.261034] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.261034] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.261034] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.261034] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.271248] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: IN_PROGRESS for 2s [ 912.531607] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-749 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.531683] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-749" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.531964] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-749" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.532154] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-749" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.532334] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.532485] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.532600] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.532813] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.533137] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.533298] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 912.533298] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 912.534962] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 912.534962] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 912.534962] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 912.534962] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 912.534962] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 912.555031] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 912.555031] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 912.555031] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 912.555668] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-749" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.556160] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-057d60e5-096d-431b-a3ae-ede2e070353a taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.556398] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-057d60e5-096d-431b-a3ae-ede2e070353a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.556524] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-057d60e5-096d-431b-a3ae-ede2e070353a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.556841] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-057d60e5-096d-431b-a3ae-ede2e070353a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.557015] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('057d60e5-096d-431b-a3ae-ede2e070353a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.586172] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bf10448-5be8-4851-a7f0-5ce51163751a in Status: SUCCESS [ 912.586394] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bf10448-5be8-4851-a7f0-5ce51163751a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.586544] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bf10448-5be8-4851-a7f0-5ce51163751a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.586785] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bf10448-5be8-4851-a7f0-5ce51163751a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.586920] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.587048] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.587117] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.587269] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.587349] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.587433] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bf10448-5be8-4851-a7f0-5ce51163751a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.587524] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7bf10448-5be8-4851-a7f0-5ce51163751a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.593676] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49023ece-127e-45b7-853d-a7309ff27819 in Status: SUCCESS [ 912.593879] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.060861] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.062409] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.062409] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.062409] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.062409] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.062409] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port 057d60e5-096d-431b-a3ae-ede2e070353a not found, creating... [ 913.062409] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.062409] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.062409] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.062669] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.062669] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.062922] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.063747] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.065912] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.065912] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.065912] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.065912] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: 057d60e5-096d-431b-a3ae-ede2e070353a is going to be created. [ 913.090392] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.090392] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.090392] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.090392] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.090683] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.091082] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-057d60e5-096d-431b-a3ae-ede2e070353a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.093034] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7bf10448-5be8-4851-a7f0-5ce51163751a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.597021] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7bf10448-5be8-4851-a7f0-5ce51163751a: rpc.has_security_group_logging(os_id): False [ 913.614500] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.614690] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.614690] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.615067] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.615201] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.615538] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.615702] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.615773] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.615943] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.616271] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.616423] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7bf10448-5be8-4851-a7f0-5ce51163751a is going to be created. [ 913.673819] env[65943]: INFO networking_nsxv3.common.synchronization [None req-d9edca02-247f-4262-a504-bb31e8784346 None None] Enqueued Resource ID: 423f4ffe-4627-491e-bb1b-e0b694b1a199 with Priority: HIGHEST for action port [ 913.674820] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 423f4ffe-4627-491e-bb1b-e0b694b1a199 with Priority: HIGHEST for action port [ 913.675165] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-423f4ffe-4627-491e-bb1b-e0b694b1a199 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.675316] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-423f4ffe-4627-491e-bb1b-e0b694b1a199" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.675412] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-423f4ffe-4627-491e-bb1b-e0b694b1a199" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.675730] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-423f4ffe-4627-491e-bb1b-e0b694b1a199" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.675849] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('423f4ffe-4627-491e-bb1b-e0b694b1a199',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.709220] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.709418] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.709491] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.709777] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.710102] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.726579] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7bf10448-5be8-4851-a7f0-5ce51163751a in Status: IN_PROGRESS for 2s [ 913.851081] env[65943]: INFO networking_nsxv3.common.synchronization [req-bed84b36-0335-4563-9afc-fb3b81cf90d1 req-a0eadb71-c9cf-4873-9b5c-f220963659a2 service nova] Enqueued Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_rules [ 913.851521] env[65943]: INFO networking_nsxv3.common.synchronization [req-bed84b36-0335-4563-9afc-fb3b81cf90d1 req-a0eadb71-c9cf-4873-9b5c-f220963659a2 service nova] Enqueued Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_members [ 913.851781] env[65943]: INFO networking_nsxv3.common.synchronization [req-bed84b36-0335-4563-9afc-fb3b81cf90d1 req-a0eadb71-c9cf-4873-9b5c-f220963659a2 service nova] Enqueued Resource ID: 057d60e5-096d-431b-a3ae-ede2e070353a with Priority: HIGHEST for action port [ 913.852912] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_rules [ 913.853345] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_members [ 913.854080] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 057d60e5-096d-431b-a3ae-ede2e070353a with Priority: HIGHEST for action port [ 913.854864] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.857053] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.857053] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.857053] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.857053] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.857053] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.857053] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.857053] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-057d60e5-096d-431b-a3ae-ede2e070353a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.857053] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-057d60e5-096d-431b-a3ae-ede2e070353a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.857479] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-057d60e5-096d-431b-a3ae-ede2e070353a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.857479] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-057d60e5-096d-431b-a3ae-ede2e070353a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.857634] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('057d60e5-096d-431b-a3ae-ede2e070353a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.178021] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 423f4ffe-4627-491e-bb1b-e0b694b1a199 [ 914.178021] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.178021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.178393] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.178393] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.178393] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.178479] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:423f4ffe-4627-491e-bb1b-e0b694b1a199 already deleted. [ 914.178573] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-423f4ffe-4627-491e-bb1b-e0b694b1a199" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.286408] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: SUCCESS [ 914.286408] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 deletion is rescheduled due to dependency. [ 914.286408] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.286408] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.286408] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.286408] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.286408] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.286408] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.286408] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.286839] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.286839] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.360988] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.361313] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.362521] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 057d60e5-096d-431b-a3ae-ede2e070353a with status ACTIVE [ 914.362521] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.362521] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.362521] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.362521] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.362521] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.362521] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.362521] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.362899] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.365231] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.365350] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.365620] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.365732] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.365796] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.365964] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.367093] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.367220] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 057d60e5-096d-431b-a3ae-ede2e070353a is going to be updated. [ 914.390456] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.390456] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.390456] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.390456] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.390456] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.390456] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-057d60e5-096d-431b-a3ae-ede2e070353a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.790301] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.294251] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.739211] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7bf10448-5be8-4851-a7f0-5ce51163751a in Status: SUCCESS [ 915.742026] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7bf10448-5be8-4851-a7f0-5ce51163751a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.796744] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.796976] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.797125] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.797381] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.797513] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.797687] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 is going to be updated. [ 915.832062] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.832521] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.832521] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.832521] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.832634] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.845041] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: IN_PROGRESS for 2s [ 916.514407] env[65943]: INFO networking_nsxv3.common.synchronization [req-cd5b8ef7-b300-4823-8ec5-d5668de57b8c req-2986610d-c757-4d0c-9fe2-26fd53548b0c tempest-ImagesTestJSON-196343566 tempest-ImagesTestJSON-196343566-project-member] Enqueued Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_members [ 916.515037] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_members [ 916.515407] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c81f5e-9888-4914-ab90-42d06116db49 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.515537] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.515605] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.515813] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.515969] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.517224] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.517335] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.518928] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.518928] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.518928] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.893531] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-40 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.893806] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-40" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.893962] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-40" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.894393] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-40" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.894812] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.895080] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.895297] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.895624] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.895804] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.896071] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 916.896179] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 916.896289] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 916.896395] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 916.896507] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 916.896612] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 916.896747] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 916.916834] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 916.917027] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 916.917209] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 916.917405] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-40" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.917776] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-45cbe0c8-6f1c-4022-9345-83085f552269 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.917952] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-45cbe0c8-6f1c-4022-9345-83085f552269" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.918087] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-45cbe0c8-6f1c-4022-9345-83085f552269" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.918405] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-45cbe0c8-6f1c-4022-9345-83085f552269" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.918626] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45cbe0c8-6f1c-4022-9345-83085f552269',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.021202] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.423312] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.423312] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.423312] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.423845] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.423845] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.423845] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port 45cbe0c8-6f1c-4022-9345-83085f552269 not found, creating... [ 917.424203] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.424304] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.424362] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.424602] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.424730] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.425051] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.425232] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.425348] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.425588] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.426030] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.426030] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: 45cbe0c8-6f1c-4022-9345-83085f552269 is going to be created. [ 917.453992] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.454256] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.454378] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.454934] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.455950] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.455950] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-45cbe0c8-6f1c-4022-9345-83085f552269" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.525229] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.856335] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: SUCCESS [ 917.856335] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.856641] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.856730] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.857187] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.857187] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.857187] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.857416] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.857447] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.857511] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.857636] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.027848] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.028147] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.028298] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.029050] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.029050] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.029050] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c81f5e-9888-4914-ab90-42d06116db49 is going to be updated. [ 918.117940] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.118150] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.118219] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.118458] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.118613] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.141588] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c81f5e-9888-4914-ab90-42d06116db49 in Status: IN_PROGRESS for 2s [ 918.189846] env[65943]: INFO networking_nsxv3.common.synchronization [req-cd5b8ef7-b300-4823-8ec5-d5668de57b8c req-37354a35-e341-4977-9071-028be01d01d5 service nova] Enqueued Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_rules [ 918.189992] env[65943]: INFO networking_nsxv3.common.synchronization [req-cd5b8ef7-b300-4823-8ec5-d5668de57b8c req-37354a35-e341-4977-9071-028be01d01d5 service nova] Enqueued Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_members [ 918.190298] env[65943]: INFO networking_nsxv3.common.synchronization [req-cd5b8ef7-b300-4823-8ec5-d5668de57b8c req-37354a35-e341-4977-9071-028be01d01d5 service nova] Enqueued Resource ID: 45cbe0c8-6f1c-4022-9345-83085f552269 with Priority: HIGHEST for action port [ 918.190747] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_rules [ 918.190822] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_members [ 918.191747] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cbe0c8-6f1c-4022-9345-83085f552269 with Priority: HIGHEST for action port [ 918.191747] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0c81f5e-9888-4914-ab90-42d06116db49 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.192038] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.192038] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.192145] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.192194] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.193578] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c81f5e-9888-4914-ab90-42d06116db49 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.193674] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.194849] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-45cbe0c8-6f1c-4022-9345-83085f552269 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.194849] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45cbe0c8-6f1c-4022-9345-83085f552269" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.194849] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45cbe0c8-6f1c-4022-9345-83085f552269" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.194992] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45cbe0c8-6f1c-4022-9345-83085f552269" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.194992] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45cbe0c8-6f1c-4022-9345-83085f552269',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.307107] env[65943]: INFO networking_nsxv3.common.synchronization [req-e1f35975-8b5b-46b7-b4a9-91c863fc2133 req-cf2b9f5d-8261-4500-84fb-3e2b9741cf0e tempest-ListImageFiltersTestJSON-1963006750 tempest-ListImageFiltersTestJSON-1963006750-project-member] Enqueued Resource ID: c00c3594-d682-43fb-9d53-d5100f161d24 with Priority: HIGHEST for action security_group_members [ 918.307755] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c00c3594-d682-43fb-9d53-d5100f161d24 with Priority: HIGHEST for action security_group_members [ 918.308892] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c00c3594-d682-43fb-9d53-d5100f161d24 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.309552] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.309552] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.309552] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.309552] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.309793] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.309793] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.310032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.310189] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.310326] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c00c3594-d682-43fb-9d53-d5100f161d24',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.359549] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.360846] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.360846] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.360981] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.361183] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.361303] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.361369] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.361535] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.361654] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.361803] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.362008] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.362128] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.362199] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.362376] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.362905] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.362905] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.362905] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.363067] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.363209] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.363287] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.363381] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.695281] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c81f5e-9888-4914-ab90-42d06116db49 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.695910] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.698653] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 45cbe0c8-6f1c-4022-9345-83085f552269 with status ACTIVE [ 918.698873] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.699060] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.699060] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.699965] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.700980] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.701233] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.701382] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.702850] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.702850] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.702850] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.702850] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.702850] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.702850] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.702850] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.702850] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.702850] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 45cbe0c8-6f1c-4022-9345-83085f552269 is going to be updated. [ 918.731437] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.732343] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.732590] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.732946] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.733244] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.733544] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45cbe0c8-6f1c-4022-9345-83085f552269" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.814436] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.814436] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.814436] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.814436] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.851517] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.851908] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.852169] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.852169] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.852402] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.852505] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.852606] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c00c3594-d682-43fb-9d53-d5100f161d24 is going to be updated. [ 918.867044] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15454ceb-9062-41fb-908b-b5ae144dbe65: rpc.has_security_group_logging(os_id): False [ 918.901554] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.901554] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.901779] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.901846] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.901952] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.902726] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.902726] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.902726] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.902726] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.902726] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.904109] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.904109] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.904109] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.904109] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.904109] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.904109] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.904109] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.904109] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.904109] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.904109] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.904109] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 is going to be updated. [ 918.924491] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.924683] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.924777] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.925057] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.925248] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.936341] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c00c3594-d682-43fb-9d53-d5100f161d24 in Status: IN_PROGRESS for 2s [ 919.006496] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.006496] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.006496] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.006496] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.006496] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.027594] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: IN_PROGRESS for 2s [ 920.158566] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c81f5e-9888-4914-ab90-42d06116db49 in Status: SUCCESS [ 920.158566] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.158566] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.158566] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.158566] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.158566] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.158566] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.158566] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.158566] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.158566] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.663028] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.948638] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c00c3594-d682-43fb-9d53-d5100f161d24 in Status: SUCCESS [ 920.949443] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c00c3594-d682-43fb-9d53-d5100f161d24 deletion is rescheduled due to dependency. [ 920.949443] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.054751] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: SUCCESS [ 921.054751] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.165019] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.668170] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.669166] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.669166] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.669166] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.669166] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.669166] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c81f5e-9888-4914-ab90-42d06116db49 is going to be updated. [ 921.698225] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.698382] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.699028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.699028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.699028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.720804] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c81f5e-9888-4914-ab90-42d06116db49 in Status: IN_PROGRESS for 2s [ 921.858183] env[65943]: INFO networking_nsxv3.common.synchronization [req-7bc83ccc-c05c-4ba5-9ade-c994c021d76c req-f8f9a68a-3b6d-4a3f-947c-706ed60354a3 tempest-ServerActionsTestOtherA-92071881 tempest-ServerActionsTestOtherA-92071881-project-member] Enqueued Resource ID: 45bb0dcc-2197-4aae-a058-937524e3408a with Priority: HIGHEST for action security_group_members [ 921.858860] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45bb0dcc-2197-4aae-a058-937524e3408a with Priority: HIGHEST for action security_group_members [ 921.859187] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-45bb0dcc-2197-4aae-a058-937524e3408a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.859325] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45bb0dcc-2197-4aae-a058-937524e3408a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.859366] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45bb0dcc-2197-4aae-a058-937524e3408a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.859620] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45bb0dcc-2197-4aae-a058-937524e3408a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.860142] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.860142] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.860142] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.860142] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.860142] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.860359] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45bb0dcc-2197-4aae-a058-937524e3408a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.316297] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-863 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.316658] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-863" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.316658] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-863" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.316934] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-863" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.319063] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.319248] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.319391] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.319675] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.319890] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.320180] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 922.320311] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 922.320422] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 922.320533] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 922.320696] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 922.320874] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 922.321098] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 922.342848] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 922.343040] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 922.343179] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 922.343356] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-863" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.343700] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-57839819-da66-405f-8ce2-b6b03be22bfb taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.344134] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-57839819-da66-405f-8ce2-b6b03be22bfb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.344304] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-57839819-da66-405f-8ce2-b6b03be22bfb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.344662] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-57839819-da66-405f-8ce2-b6b03be22bfb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.344846] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57839819-da66-405f-8ce2-b6b03be22bfb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.362378] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.362574] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.362574] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.362790] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.362885] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.363081] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.363180] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.363240] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.363393] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.363474] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.363586] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45bb0dcc-2197-4aae-a058-937524e3408a already deleted. [ 922.363674] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45bb0dcc-2197-4aae-a058-937524e3408a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.848508] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.848839] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.848985] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.849292] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.849474] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.849671] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port 57839819-da66-405f-8ce2-b6b03be22bfb not found, creating... [ 922.850041] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.850231] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.850393] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.850649] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.850794] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.851188] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.851778] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.851778] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.851778] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.851920] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.852052] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: 57839819-da66-405f-8ce2-b6b03be22bfb is going to be created. [ 922.875655] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.875894] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.876030] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.876389] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.876573] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.876851] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-57839819-da66-405f-8ce2-b6b03be22bfb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.383693] env[65943]: INFO networking_nsxv3.common.synchronization [None req-e6efe055-3b8d-452f-af04-44acb508bf90 None None] Enqueued Resource ID: 6b896a9c-b56c-441e-82a8-fbecfa12423a with Priority: HIGHEST for action port [ 923.384286] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b896a9c-b56c-441e-82a8-fbecfa12423a with Priority: HIGHEST for action port [ 923.385008] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b896a9c-b56c-441e-82a8-fbecfa12423a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.385145] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b896a9c-b56c-441e-82a8-fbecfa12423a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.385211] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b896a9c-b56c-441e-82a8-fbecfa12423a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.385472] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b896a9c-b56c-441e-82a8-fbecfa12423a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.385589] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b896a9c-b56c-441e-82a8-fbecfa12423a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.623637] env[65943]: INFO networking_nsxv3.common.synchronization [req-7bc83ccc-c05c-4ba5-9ade-c994c021d76c req-443bdc83-3048-456d-8f3a-478e71f62ecf service nova] Enqueued Resource ID: 45bb0dcc-2197-4aae-a058-937524e3408a with Priority: HIGHEST for action security_group_rules [ 923.623821] env[65943]: INFO networking_nsxv3.common.synchronization [req-7bc83ccc-c05c-4ba5-9ade-c994c021d76c req-443bdc83-3048-456d-8f3a-478e71f62ecf service nova] Enqueued Resource ID: 45bb0dcc-2197-4aae-a058-937524e3408a with Priority: HIGHEST for action security_group_members [ 923.623959] env[65943]: INFO networking_nsxv3.common.synchronization [req-7bc83ccc-c05c-4ba5-9ade-c994c021d76c req-443bdc83-3048-456d-8f3a-478e71f62ecf service nova] Enqueued Resource ID: 57839819-da66-405f-8ce2-b6b03be22bfb with Priority: HIGHEST for action port [ 923.624507] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45bb0dcc-2197-4aae-a058-937524e3408a with Priority: HIGHEST for action security_group_rules [ 923.624642] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45bb0dcc-2197-4aae-a058-937524e3408a with Priority: HIGHEST for action security_group_members [ 923.624744] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57839819-da66-405f-8ce2-b6b03be22bfb with Priority: HIGHEST for action port [ 923.626066] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45bb0dcc-2197-4aae-a058-937524e3408a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.626270] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45bb0dcc-2197-4aae-a058-937524e3408a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.626347] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45bb0dcc-2197-4aae-a058-937524e3408a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.626549] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45bb0dcc-2197-4aae-a058-937524e3408a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.626636] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45bb0dcc-2197-4aae-a058-937524e3408a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.627539] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-45bb0dcc-2197-4aae-a058-937524e3408a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.627686] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45bb0dcc-2197-4aae-a058-937524e3408a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.627751] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45bb0dcc-2197-4aae-a058-937524e3408a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.627902] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45bb0dcc-2197-4aae-a058-937524e3408a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.628092] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.628194] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.628254] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.628398] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.628482] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.628571] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45bb0dcc-2197-4aae-a058-937524e3408a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.629620] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-57839819-da66-405f-8ce2-b6b03be22bfb taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.630216] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57839819-da66-405f-8ce2-b6b03be22bfb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.630216] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57839819-da66-405f-8ce2-b6b03be22bfb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.630216] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57839819-da66-405f-8ce2-b6b03be22bfb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.631801] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57839819-da66-405f-8ce2-b6b03be22bfb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.728368] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c81f5e-9888-4914-ab90-42d06116db49 in Status: SUCCESS [ 923.728908] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.728908] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.729058] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.729171] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.729289] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.729353] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.729502] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.729587] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.729671] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.729764] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.888436] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6b896a9c-b56c-441e-82a8-fbecfa12423a [ 923.888940] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.889843] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.889843] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.889843] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.889843] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.889843] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6b896a9c-b56c-441e-82a8-fbecfa12423a already deleted. [ 923.889843] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b896a9c-b56c-441e-82a8-fbecfa12423a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.134376] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-45bb0dcc-2197-4aae-a058-937524e3408a taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.134698] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45bb0dcc-2197-4aae-a058-937524e3408a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.135943] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45bb0dcc-2197-4aae-a058-937524e3408a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.139660] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 57839819-da66-405f-8ce2-b6b03be22bfb with status ACTIVE [ 924.139660] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.139660] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.139660] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.139660] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.141143] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.141421] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.141536] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.141587] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.142319] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.142319] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.142319] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.142319] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.142319] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.142562] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.142591] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.142690] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 57839819-da66-405f-8ce2-b6b03be22bfb is going to be updated. [ 924.169616] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.169887] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.169949] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.170303] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.170665] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.170784] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57839819-da66-405f-8ce2-b6b03be22bfb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.236023] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c81f5e-9888-4914-ab90-42d06116db49 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.236023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.236023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.236023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.236023] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.236023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.236023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.236023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.236023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.236023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.236023] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c81f5e-9888-4914-ab90-42d06116db49 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.236023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.236023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.236023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.236023] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.236023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.236779] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.236779] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.236779] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.236779] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.236779] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.645027] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45bb0dcc-2197-4aae-a058-937524e3408a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.739698] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0c81f5e-9888-4914-ab90-42d06116db49: rpc.has_security_group_logging(os_id): False [ 924.762633] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.762936] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.763146] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.763461] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.786891] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.786891] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.786891] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.786891] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.786891] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.786891] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.786891] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.786891] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.786891] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.786891] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.786891] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.786891] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.786891] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.786891] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.787574] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.787574] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.787574] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0c81f5e-9888-4914-ab90-42d06116db49 is going to be updated. [ 924.903078] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.903291] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.903400] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.903636] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.903783] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.949231] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0c81f5e-9888-4914-ab90-42d06116db49 in Status: IN_PROGRESS for 2s [ 925.149696] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.150129] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.151050] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.151346] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.151401] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.151511] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45bb0dcc-2197-4aae-a058-937524e3408a is going to be created. [ 925.178267] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.178425] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.178507] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.178732] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.178914] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.190694] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45bb0dcc-2197-4aae-a058-937524e3408a in Status: UNINITIALIZED for 2s [ 925.664641] env[65943]: INFO networking_nsxv3.common.synchronization [req-5517d0f0-ac59-4ef8-b704-ab9e6d9a1c4d req-af4c4ed5-7cc4-431c-bb5f-eb1d4b966d4f tempest-ServerRescueTestJSONUnderV235-819256366 tempest-ServerRescueTestJSONUnderV235-819256366-project-member] Enqueued Resource ID: 49023ece-127e-45b7-853d-a7309ff27819 with Priority: HIGHEST for action security_group_members [ 925.665087] env[65943]: INFO networking_nsxv3.common.synchronization [req-5517d0f0-ac59-4ef8-b704-ab9e6d9a1c4d req-af4c4ed5-7cc4-431c-bb5f-eb1d4b966d4f tempest-ServerRescueTestJSONUnderV235-819256366 tempest-ServerRescueTestJSONUnderV235-819256366-project-member] Enqueued Resource ID: e96b0476-c1fa-45c4-a943-06afd25c7196 with Priority: HIGHEST for action security_group_members [ 925.666070] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49023ece-127e-45b7-853d-a7309ff27819 with Priority: HIGHEST for action security_group_members [ 925.666274] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e96b0476-c1fa-45c4-a943-06afd25c7196 with Priority: HIGHEST for action security_group_members [ 925.666605] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-49023ece-127e-45b7-853d-a7309ff27819 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.666766] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.666867] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.667350] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.667620] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.667896] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.668246] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.668353] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.668436] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.668599] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49023ece-127e-45b7-853d-a7309ff27819',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.669736] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e96b0476-c1fa-45c4-a943-06afd25c7196 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.670281] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e96b0476-c1fa-45c4-a943-06afd25c7196" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.670359] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e96b0476-c1fa-45c4-a943-06afd25c7196" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.670623] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e96b0476-c1fa-45c4-a943-06afd25c7196" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.670797] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.670898] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.670964] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.671175] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.671264] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.671362] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e96b0476-c1fa-45c4-a943-06afd25c7196',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.734329] env[65943]: INFO networking_nsxv3.common.synchronization [req-5517d0f0-ac59-4ef8-b704-ab9e6d9a1c4d req-af4c4ed5-7cc4-431c-bb5f-eb1d4b966d4f tempest-ServerRescueTestJSONUnderV235-819256366 tempest-ServerRescueTestJSONUnderV235-819256366-project-member] Enqueued Resource ID: 49023ece-127e-45b7-853d-a7309ff27819 with Priority: HIGHEST for action security_group_rules [ 925.734504] env[65943]: INFO networking_nsxv3.common.synchronization [req-5517d0f0-ac59-4ef8-b704-ab9e6d9a1c4d req-af4c4ed5-7cc4-431c-bb5f-eb1d4b966d4f tempest-ServerRescueTestJSONUnderV235-819256366 tempest-ServerRescueTestJSONUnderV235-819256366-project-member] Enqueued Resource ID: 49023ece-127e-45b7-853d-a7309ff27819 with Priority: HIGHEST for action security_group_members [ 925.734640] env[65943]: INFO networking_nsxv3.common.synchronization [req-5517d0f0-ac59-4ef8-b704-ab9e6d9a1c4d req-af4c4ed5-7cc4-431c-bb5f-eb1d4b966d4f tempest-ServerRescueTestJSONUnderV235-819256366 tempest-ServerRescueTestJSONUnderV235-819256366-project-member] Enqueued Resource ID: e96b0476-c1fa-45c4-a943-06afd25c7196 with Priority: HIGHEST for action security_group_rules [ 925.734771] env[65943]: INFO networking_nsxv3.common.synchronization [req-5517d0f0-ac59-4ef8-b704-ab9e6d9a1c4d req-af4c4ed5-7cc4-431c-bb5f-eb1d4b966d4f tempest-ServerRescueTestJSONUnderV235-819256366 tempest-ServerRescueTestJSONUnderV235-819256366-project-member] Enqueued Resource ID: e96b0476-c1fa-45c4-a943-06afd25c7196 with Priority: HIGHEST for action security_group_members [ 925.734900] env[65943]: INFO networking_nsxv3.common.synchronization [req-5517d0f0-ac59-4ef8-b704-ab9e6d9a1c4d req-af4c4ed5-7cc4-431c-bb5f-eb1d4b966d4f tempest-ServerRescueTestJSONUnderV235-819256366 tempest-ServerRescueTestJSONUnderV235-819256366-project-member] Enqueued Resource ID: f20016b3-cfc1-4147-bd55-2db4e8a030d0 with Priority: HIGHEST for action port [ 925.735490] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49023ece-127e-45b7-853d-a7309ff27819 with Priority: HIGHEST for action security_group_rules [ 925.735953] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e96b0476-c1fa-45c4-a943-06afd25c7196 with Priority: HIGHEST for action security_group_rules [ 925.736157] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f20016b3-cfc1-4147-bd55-2db4e8a030d0 with Priority: HIGHEST for action port [ 925.736274] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49023ece-127e-45b7-853d-a7309ff27819 with Priority: HIGHEST for action security_group_members [ 925.736377] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e96b0476-c1fa-45c4-a943-06afd25c7196 with Priority: HIGHEST for action security_group_members [ 925.736750] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49023ece-127e-45b7-853d-a7309ff27819 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.736882] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.736951] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.737186] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.737270] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49023ece-127e-45b7-853d-a7309ff27819',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.738384] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e96b0476-c1fa-45c4-a943-06afd25c7196 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.738501] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e96b0476-c1fa-45c4-a943-06afd25c7196" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.738593] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e96b0476-c1fa-45c4-a943-06afd25c7196" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.738828] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e96b0476-c1fa-45c4-a943-06afd25c7196" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.738915] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e96b0476-c1fa-45c4-a943-06afd25c7196',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.740517] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-f20016b3-cfc1-4147-bd55-2db4e8a030d0 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.740517] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f20016b3-cfc1-4147-bd55-2db4e8a030d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.740517] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f20016b3-cfc1-4147-bd55-2db4e8a030d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.740803] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f20016b3-cfc1-4147-bd55-2db4e8a030d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.740803] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f20016b3-cfc1-4147-bd55-2db4e8a030d0',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.741558] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-49023ece-127e-45b7-853d-a7309ff27819 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.741742] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.741859] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e96b0476-c1fa-45c4-a943-06afd25c7196 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.741899] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e96b0476-c1fa-45c4-a943-06afd25c7196" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.073607] env[65943]: INFO networking_nsxv3.common.synchronization [None req-eb04a540-8be8-442e-bff7-e2f837f30379 None None] Enqueued Resource ID: 7af8fa2f-ff47-4b16-9ac9-db8671f50d17 with Priority: HIGHEST for action port [ 926.073956] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7af8fa2f-ff47-4b16-9ac9-db8671f50d17 with Priority: HIGHEST for action port [ 926.074500] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-7af8fa2f-ff47-4b16-9ac9-db8671f50d17 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.074634] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7af8fa2f-ff47-4b16-9ac9-db8671f50d17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.074693] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7af8fa2f-ff47-4b16-9ac9-db8671f50d17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.074955] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7af8fa2f-ff47-4b16-9ac9-db8671f50d17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.075114] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7af8fa2f-ff47-4b16-9ac9-db8671f50d17',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.174460] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49023ece-127e-45b7-853d-a7309ff27819',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.177133] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e96b0476-c1fa-45c4-a943-06afd25c7196',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.243137] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-49023ece-127e-45b7-853d-a7309ff27819 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.243299] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.243513] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e96b0476-c1fa-45c4-a943-06afd25c7196 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.243615] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e96b0476-c1fa-45c4-a943-06afd25c7196" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.246627] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f20016b3-cfc1-4147-bd55-2db4e8a030d0 with status ACTIVE [ 926.246627] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.246627] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.246627] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.246870] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.246870] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.246998] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.247203] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.247270] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.247431] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.247549] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.248073] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.248194] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.248262] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.248422] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.248504] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.248593] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f20016b3-cfc1-4147-bd55-2db4e8a030d0 is going to be updated. [ 926.274198] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.274198] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.274198] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.274412] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.274587] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.274734] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f20016b3-cfc1-4147-bd55-2db4e8a030d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.577242] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7af8fa2f-ff47-4b16-9ac9-db8671f50d17 [ 926.577491] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.577625] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.577744] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.577970] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.578076] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.578176] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7af8fa2f-ff47-4b16-9ac9-db8671f50d17 already deleted. [ 926.578259] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7af8fa2f-ff47-4b16-9ac9-db8671f50d17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.681865] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49023ece-127e-45b7-853d-a7309ff27819',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.682670] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e96b0476-c1fa-45c4-a943-06afd25c7196',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.793899] env[65943]: INFO networking_nsxv3.common.synchronization [req-79a53b7d-31ca-4f0c-80b3-2955a34dd1a9 req-bf38dfe9-99d9-46ca-8a49-fc293f27007d tempest-ServerRescueTestJSONUnderV235-819256366 tempest-ServerRescueTestJSONUnderV235-819256366-project-member] Enqueued Resource ID: 49023ece-127e-45b7-853d-a7309ff27819 with Priority: HIGHEST for action security_group_members [ 926.794838] env[65943]: INFO networking_nsxv3.common.synchronization [req-79a53b7d-31ca-4f0c-80b3-2955a34dd1a9 req-bf38dfe9-99d9-46ca-8a49-fc293f27007d tempest-ServerRescueTestJSONUnderV235-819256366 tempest-ServerRescueTestJSONUnderV235-819256366-project-member] Enqueued Resource ID: e96b0476-c1fa-45c4-a943-06afd25c7196 with Priority: HIGHEST for action security_group_members [ 926.795215] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49023ece-127e-45b7-853d-a7309ff27819 with Priority: HIGHEST for action security_group_members [ 926.796081] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e96b0476-c1fa-45c4-a943-06afd25c7196 with Priority: HIGHEST for action security_group_members [ 926.796081] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-49023ece-127e-45b7-853d-a7309ff27819 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.796081] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.796253] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e96b0476-c1fa-45c4-a943-06afd25c7196 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.797087] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e96b0476-c1fa-45c4-a943-06afd25c7196" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.869093] env[65943]: INFO networking_nsxv3.common.synchronization [req-79a53b7d-31ca-4f0c-80b3-2955a34dd1a9 req-bf38dfe9-99d9-46ca-8a49-fc293f27007d tempest-ServerRescueTestJSONUnderV235-819256366 tempest-ServerRescueTestJSONUnderV235-819256366-project-member] Enqueued Resource ID: 49023ece-127e-45b7-853d-a7309ff27819 with Priority: HIGHEST for action security_group_rules [ 926.869093] env[65943]: INFO networking_nsxv3.common.synchronization [req-79a53b7d-31ca-4f0c-80b3-2955a34dd1a9 req-bf38dfe9-99d9-46ca-8a49-fc293f27007d tempest-ServerRescueTestJSONUnderV235-819256366 tempest-ServerRescueTestJSONUnderV235-819256366-project-member] Enqueued Resource ID: 49023ece-127e-45b7-853d-a7309ff27819 with Priority: HIGHEST for action security_group_members [ 926.869093] env[65943]: INFO networking_nsxv3.common.synchronization [req-79a53b7d-31ca-4f0c-80b3-2955a34dd1a9 req-bf38dfe9-99d9-46ca-8a49-fc293f27007d tempest-ServerRescueTestJSONUnderV235-819256366 tempest-ServerRescueTestJSONUnderV235-819256366-project-member] Enqueued Resource ID: f20016b3-cfc1-4147-bd55-2db4e8a030d0 with Priority: HIGHEST for action port [ 926.869093] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49023ece-127e-45b7-853d-a7309ff27819 with Priority: HIGHEST for action security_group_rules [ 926.869093] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49023ece-127e-45b7-853d-a7309ff27819 with Priority: HIGHEST for action security_group_members [ 926.869093] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f20016b3-cfc1-4147-bd55-2db4e8a030d0 with Priority: HIGHEST for action port [ 926.869093] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49023ece-127e-45b7-853d-a7309ff27819 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.869093] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.869093] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-49023ece-127e-45b7-853d-a7309ff27819 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.869093] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.869093] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-f20016b3-cfc1-4147-bd55-2db4e8a030d0 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.869093] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f20016b3-cfc1-4147-bd55-2db4e8a030d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.869093] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f20016b3-cfc1-4147-bd55-2db4e8a030d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.869093] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f20016b3-cfc1-4147-bd55-2db4e8a030d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.869093] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f20016b3-cfc1-4147-bd55-2db4e8a030d0',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.968936] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0c81f5e-9888-4914-ab90-42d06116db49 in Status: SUCCESS [ 926.969198] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.184564] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.184745] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.184812] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.185121] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.185224] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.185328] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49023ece-127e-45b7-853d-a7309ff27819 is going to be updated. [ 927.186752] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.186931] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.187033] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.187246] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.187333] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.187423] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e96b0476-c1fa-45c4-a943-06afd25c7196 is going to be created. [ 927.202506] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45bb0dcc-2197-4aae-a058-937524e3408a in Status: SUCCESS [ 927.202727] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45bb0dcc-2197-4aae-a058-937524e3408a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.202895] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45bb0dcc-2197-4aae-a058-937524e3408a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.203142] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45bb0dcc-2197-4aae-a058-937524e3408a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.203378] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.203735] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.203735] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.203735] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.203904] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.203904] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45bb0dcc-2197-4aae-a058-937524e3408a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.203996] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('45bb0dcc-2197-4aae-a058-937524e3408a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.222260] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.222260] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.222260] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.222478] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.222639] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.234379] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.234379] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.234379] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.234630] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.234630] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.237979] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e96b0476-c1fa-45c4-a943-06afd25c7196 in Status: UNINITIALIZED for 2s [ 927.246797] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49023ece-127e-45b7-853d-a7309ff27819 in Status: IN_PROGRESS for 2s [ 927.374221] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f20016b3-cfc1-4147-bd55-2db4e8a030d0 with status ACTIVE [ 927.374221] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.374221] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.374221] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.374221] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.374573] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.374647] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.374790] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.374998] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.375257] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.375380] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.375614] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.375755] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.375850] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.376044] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.376156] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.376273] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f20016b3-cfc1-4147-bd55-2db4e8a030d0 is going to be updated. [ 927.401027] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.401027] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.401027] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.401027] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.401027] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.401027] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f20016b3-cfc1-4147-bd55-2db4e8a030d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.706479] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('45bb0dcc-2197-4aae-a058-937524e3408a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.208411] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 45bb0dcc-2197-4aae-a058-937524e3408a: rpc.has_security_group_logging(os_id): False [ 928.227935] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.227935] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.227935] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.227935] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.227935] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.227935] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.228229] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.228229] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.228229] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.228325] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.228405] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45bb0dcc-2197-4aae-a058-937524e3408a is going to be created. [ 928.294614] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.294614] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.294614] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.294854] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.294854] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.307128] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45bb0dcc-2197-4aae-a058-937524e3408a in Status: IN_PROGRESS for 2s [ 929.259969] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e96b0476-c1fa-45c4-a943-06afd25c7196 in Status: SUCCESS [ 929.259969] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e96b0476-c1fa-45c4-a943-06afd25c7196" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.259969] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e96b0476-c1fa-45c4-a943-06afd25c7196" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.259969] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e96b0476-c1fa-45c4-a943-06afd25c7196" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.259969] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.259969] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.259969] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.259969] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.259969] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.259969] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e96b0476-c1fa-45c4-a943-06afd25c7196',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.263501] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49023ece-127e-45b7-853d-a7309ff27819 in Status: SUCCESS [ 929.263501] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.264404] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.264404] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.264404] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.264877] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.264877] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.265126] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.265263] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.265406] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49023ece-127e-45b7-853d-a7309ff27819',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.763231] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.763422] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.763457] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.763866] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.764492] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.765386] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.765386] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.765386] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.765386] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.765386] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.769885] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e96b0476-c1fa-45c4-a943-06afd25c7196 is going to be deleted. [ 929.769885] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49023ece-127e-45b7-853d-a7309ff27819',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.802694] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.802862] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.802940] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.803192] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.805051] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.805051] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e96b0476-c1fa-45c4-a943-06afd25c7196" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.805051] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e96b0476-c1fa-45c4-a943-06afd25c7196" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.805051] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e96b0476-c1fa-45c4-a943-06afd25c7196" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.805051] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.805051] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.805051] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.805051] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.805051] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.805051] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e96b0476-c1fa-45c4-a943-06afd25c7196',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.272649] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49023ece-127e-45b7-853d-a7309ff27819',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.311052] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.311299] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.311375] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.312048] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.312048] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.312048] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.312048] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.312352] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.312352] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.312352] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.312527] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e96b0476-c1fa-45c4-a943-06afd25c7196 already deleted. [ 930.312527] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e96b0476-c1fa-45c4-a943-06afd25c7196" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.312633] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e96b0476-c1fa-45c4-a943-06afd25c7196',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.313539] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e96b0476-c1fa-45c4-a943-06afd25c7196" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.313733] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e96b0476-c1fa-45c4-a943-06afd25c7196" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.314048] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.315520] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.315520] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.315520] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.315520] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.315520] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e96b0476-c1fa-45c4-a943-06afd25c7196',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.324452] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45bb0dcc-2197-4aae-a058-937524e3408a in Status: SUCCESS [ 930.324452] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45bb0dcc-2197-4aae-a058-937524e3408a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.584633] env[65943]: INFO networking_nsxv3.common.synchronization [None req-febdd5a3-eb73-4a96-a534-000500baa77a tempest-ServerDiskConfigTestJSON-397438939 tempest-ServerDiskConfigTestJSON-397438939-project-member] Enqueued Resource ID: fcd0451c-7e4d-46a4-9f7c-ddd5bfcf7b37 with Priority: HIGHEST for action security_group_rules [ 930.585502] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcd0451c-7e4d-46a4-9f7c-ddd5bfcf7b37 with Priority: HIGHEST for action security_group_rules [ 930.586022] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fcd0451c-7e4d-46a4-9f7c-ddd5bfcf7b37 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.586361] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fcd0451c-7e4d-46a4-9f7c-ddd5bfcf7b37" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.586361] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fcd0451c-7e4d-46a4-9f7c-ddd5bfcf7b37" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.586561] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fcd0451c-7e4d-46a4-9f7c-ddd5bfcf7b37" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.586654] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fcd0451c-7e4d-46a4-9f7c-ddd5bfcf7b37',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.739313] env[65943]: INFO networking_nsxv3.common.synchronization [None req-6a958188-755d-4a35-b8b1-4e55a6c62c05 tempest-ServerDiskConfigTestJSON-397438939 tempest-ServerDiskConfigTestJSON-397438939-project-member] Enqueued Resource ID: fcd0451c-7e4d-46a4-9f7c-ddd5bfcf7b37 with Priority: HIGHEST for action security_group_rules [ 930.739874] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcd0451c-7e4d-46a4-9f7c-ddd5bfcf7b37 with Priority: HIGHEST for action security_group_rules [ 930.740650] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fcd0451c-7e4d-46a4-9f7c-ddd5bfcf7b37 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.740650] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fcd0451c-7e4d-46a4-9f7c-ddd5bfcf7b37" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.778399] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.778399] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.778399] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.778399] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.778399] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.778399] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49023ece-127e-45b7-853d-a7309ff27819 is going to be updated. [ 930.812183] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.812366] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.812426] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.812725] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.812827] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.817870] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e96b0476-c1fa-45c4-a943-06afd25c7196',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.819506] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.820850] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.821035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.822008] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.822308] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.822605] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.822758] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.822873] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.823131] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.823228] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.823326] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e96b0476-c1fa-45c4-a943-06afd25c7196 already deleted. [ 930.823511] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e96b0476-c1fa-45c4-a943-06afd25c7196" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.824895] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49023ece-127e-45b7-853d-a7309ff27819 in Status: IN_PROGRESS for 2s [ 931.113022] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.113022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.113022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.113022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.113022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.113022] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fcd0451c-7e4d-46a4-9f7c-ddd5bfcf7b37 already deleted. [ 931.113022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fcd0451c-7e4d-46a4-9f7c-ddd5bfcf7b37" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.113022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fcd0451c-7e4d-46a4-9f7c-ddd5bfcf7b37" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.113022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fcd0451c-7e4d-46a4-9f7c-ddd5bfcf7b37" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.113022] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fcd0451c-7e4d-46a4-9f7c-ddd5bfcf7b37',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.326618] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e96b0476-c1fa-45c4-a943-06afd25c7196: rpc.has_security_group_logging(os_id): False [ 931.345404] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.345603] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.345649] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.345866] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.345969] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.346223] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.346321] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.346385] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.346585] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.346690] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.346792] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e96b0476-c1fa-45c4-a943-06afd25c7196 is going to be created. [ 931.364457] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/e96b0476-c1fa-45c4-a943-06afd25c7196], does not exist path=[/infra/domains/default/groups/e96b0476-c1fa-45c4-a943-06afd25c7196]."\n}' [ 931.364634] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e96b0476-c1fa-45c4-a943-06afd25c7196 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e96b0476-c1fa-45c4-a943-06afd25c7196 [ 931.364716] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 931.415141] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.416024] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.416024] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.416024] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.418876] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.420076] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.420076] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.420076] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.420076] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.420076] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.420076] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.420076] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.420076] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.420419] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.420419] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.420419] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e96b0476-c1fa-45c4-a943-06afd25c7196 is going to be created. [ 931.440657] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/e96b0476-c1fa-45c4-a943-06afd25c7196], does not exist path=[/infra/domains/default/groups/e96b0476-c1fa-45c4-a943-06afd25c7196]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e96b0476-c1fa-45c4-a943-06afd25c7196 [ 931.440840] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e96b0476-c1fa-45c4-a943-06afd25c7196" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.441126] env[65943]: Traceback (most recent call last): [ 931.441126] env[65943]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 931.441126] env[65943]: return func(*args, **kwargs) [ 931.441126] env[65943]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 931.441126] env[65943]: res.raise_for_status() [ 931.441126] env[65943]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 931.441126] env[65943]: raise HTTPError(http_error_msg, response=self) [ 931.441126] env[65943]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e96b0476-c1fa-45c4-a943-06afd25c7196 [ 931.441126] env[65943]: During handling of the above exception, another exception occurred: [ 931.441126] env[65943]: Traceback (most recent call last): [ 931.441402] env[65943]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 931.441402] env[65943]: listener.cb(fileno) [ 931.441402] env[65943]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 931.441402] env[65943]: result = function(*args, **kwargs) [ 931.441402] env[65943]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 931.441402] env[65943]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 931.441402] env[65943]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 931.441402] env[65943]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 931.441402] env[65943]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 931.441402] env[65943]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 931.441402] env[65943]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 931.441402] env[65943]: res.raise_for_status() [ 931.441402] env[65943]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 931.441402] env[65943]: raise HTTPError(http_error_msg, response=self) [ 931.441402] env[65943]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e96b0476-c1fa-45c4-a943-06afd25c7196 [ 931.441402] env[65943]: Removing descriptor: 58 [ 931.634677] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.634936] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.634999] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.635638] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.635638] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.635638] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fcd0451c-7e4d-46a4-9f7c-ddd5bfcf7b37 already deleted. [ 931.635638] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fcd0451c-7e4d-46a4-9f7c-ddd5bfcf7b37" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.834525] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49023ece-127e-45b7-853d-a7309ff27819 in Status: SUCCESS [ 932.834779] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.834943] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.835196] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.835400] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.835513] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.835720] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.835855] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.835911] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.835994] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.836110] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49023ece-127e-45b7-853d-a7309ff27819',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.837043] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.837260] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.838236] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.838236] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.838236] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.838236] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.838236] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.838236] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49023ece-127e-45b7-853d-a7309ff27819',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.841542] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-695 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.841542] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-695" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.841787] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-695" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.841787] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-695" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.842086] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.842294] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.842294] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.843042] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.843042] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.843042] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 932.843042] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 932.843042] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 932.843262] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 932.843262] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 932.843326] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 932.843587] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 932.862107] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 932.862418] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 932.862640] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 932.863132] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-695" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.863297] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-a15b8ac0-bdf8-41cb-91e7-40e918f3d0bd taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.863474] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-a15b8ac0-bdf8-41cb-91e7-40e918f3d0bd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.863596] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-a15b8ac0-bdf8-41cb-91e7-40e918f3d0bd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.863854] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-a15b8ac0-bdf8-41cb-91e7-40e918f3d0bd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.863995] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a15b8ac0-bdf8-41cb-91e7-40e918f3d0bd',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.344286] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-49023ece-127e-45b7-853d-a7309ff27819 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.344494] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.344704] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49023ece-127e-45b7-853d-a7309ff27819',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.366858] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.367161] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.367356] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.367730] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.367866] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.368257] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.368496] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.368650] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.368975] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.369182] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.369591] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.369833] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.369971] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.370219] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.370395] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.370574] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: a15b8ac0-bdf8-41cb-91e7-40e918f3d0bd is going to be updated. [ 933.394206] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.394501] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.394664] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.394987] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.395268] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.395516] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-a15b8ac0-bdf8-41cb-91e7-40e918f3d0bd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.848338] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49023ece-127e-45b7-853d-a7309ff27819',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.163533] env[65943]: INFO networking_nsxv3.common.synchronization [req-2ca91bc2-50f2-4b8e-b44b-292813d3950e req-be8f058f-72d2-4f2c-9f47-97462b5524ec service nova] Enqueued Resource ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 with Priority: HIGHEST for action security_group_rules [ 934.163533] env[65943]: INFO networking_nsxv3.common.synchronization [req-2ca91bc2-50f2-4b8e-b44b-292813d3950e req-be8f058f-72d2-4f2c-9f47-97462b5524ec service nova] Enqueued Resource ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 with Priority: HIGHEST for action security_group_members [ 934.163533] env[65943]: INFO networking_nsxv3.common.synchronization [req-2ca91bc2-50f2-4b8e-b44b-292813d3950e req-be8f058f-72d2-4f2c-9f47-97462b5524ec service nova] Enqueued Resource ID: a15b8ac0-bdf8-41cb-91e7-40e918f3d0bd with Priority: HIGHEST for action port [ 934.165731] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 with Priority: HIGHEST for action security_group_rules [ 934.168069] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 with Priority: HIGHEST for action security_group_members [ 934.168069] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a15b8ac0-bdf8-41cb-91e7-40e918f3d0bd with Priority: HIGHEST for action port [ 934.168501] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7544afbe-03f8-421e-b9ed-b038f61ffc17 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.168568] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.169096] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.169096] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.169096] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7544afbe-03f8-421e-b9ed-b038f61ffc17',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.171204] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7544afbe-03f8-421e-b9ed-b038f61ffc17 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.171204] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.171335] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.172254] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.172254] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.172254] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.172254] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.172254] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.172254] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.175244] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7544afbe-03f8-421e-b9ed-b038f61ffc17',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.176409] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-a15b8ac0-bdf8-41cb-91e7-40e918f3d0bd taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.176409] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a15b8ac0-bdf8-41cb-91e7-40e918f3d0bd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.176409] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a15b8ac0-bdf8-41cb-91e7-40e918f3d0bd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.176409] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a15b8ac0-bdf8-41cb-91e7-40e918f3d0bd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.176612] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a15b8ac0-bdf8-41cb-91e7-40e918f3d0bd',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.352831] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.353054] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.353161] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.353444] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.353553] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.353709] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49023ece-127e-45b7-853d-a7309ff27819 is going to be updated. [ 934.394090] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.395059] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.395261] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.396020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.396456] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.409418] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49023ece-127e-45b7-853d-a7309ff27819 in Status: IN_PROGRESS for 2s [ 934.450871] env[65943]: INFO networking_nsxv3.common.synchronization [req-96c856f2-d3b6-449b-8938-21e95ee61aed req-c95bef6b-077a-438c-87fb-983cc526f778 tempest-ServerDiskConfigTestJSON-397438939 tempest-ServerDiskConfigTestJSON-397438939-project-member] Enqueued Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_members [ 934.451557] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_members [ 934.451929] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b127ff-135f-4cd2-9456-bc11d98737ce taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.452683] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.452783] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.453011] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.453188] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.453297] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.453359] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.453516] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.453927] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.453927] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.677998] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7544afbe-03f8-421e-b9ed-b038f61ffc17 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.678201] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.678403] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7544afbe-03f8-421e-b9ed-b038f61ffc17',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.684279] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a15b8ac0-bdf8-41cb-91e7-40e918f3d0bd with status ACTIVE [ 934.684279] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.684279] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.684279] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.684279] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.684279] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.684279] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.684279] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.684279] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.684279] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.684279] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.684279] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.684279] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.684279] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.684863] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.684863] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.685100] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a15b8ac0-bdf8-41cb-91e7-40e918f3d0bd is going to be updated. [ 934.716578] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.716578] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.716578] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.716578] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.716909] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.716909] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a15b8ac0-bdf8-41cb-91e7-40e918f3d0bd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.959469] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.959469] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.959469] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.959469] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.981876] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.981876] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.982051] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.982136] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.982531] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.982531] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.982639] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9b127ff-135f-4cd2-9456-bc11d98737ce is going to be updated. [ 935.013491] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.013700] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.013768] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.014049] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.016591] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.025808] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b127ff-135f-4cd2-9456-bc11d98737ce in Status: IN_PROGRESS for 2s [ 935.058754] env[65943]: INFO networking_nsxv3.common.synchronization [req-5f6562c2-3edb-42df-a62a-6dc4985ec21e req-fab044ed-b9cc-4a74-8ca6-ea51ef09b2ec tempest-ServerRescueTestJSONUnderV235-819256366 tempest-ServerRescueTestJSONUnderV235-819256366-project-member] Enqueued Resource ID: 49023ece-127e-45b7-853d-a7309ff27819 with Priority: HIGHEST for action security_group_members [ 935.059430] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49023ece-127e-45b7-853d-a7309ff27819 with Priority: HIGHEST for action security_group_members [ 935.059767] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-49023ece-127e-45b7-853d-a7309ff27819 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.059872] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.181248] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7544afbe-03f8-421e-b9ed-b038f61ffc17',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.293016] env[65943]: INFO networking_nsxv3.common.synchronization [req-4c65ce94-8ec1-4a6a-a4fe-c54daff2f5f5 req-1a2af1a2-4e88-472e-bac5-c8436aa9a232 tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_members [ 935.293016] env[65943]: INFO networking_nsxv3.common.synchronization [req-4c65ce94-8ec1-4a6a-a4fe-c54daff2f5f5 req-1a2af1a2-4e88-472e-bac5-c8436aa9a232 tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: dcaf51d1-3d78-4731-8697-ec542f23f503 with Priority: HIGHEST for action security_group_members [ 935.293016] env[65943]: INFO networking_nsxv3.common.synchronization [req-4c65ce94-8ec1-4a6a-a4fe-c54daff2f5f5 req-1a2af1a2-4e88-472e-bac5-c8436aa9a232 tempest-SecurityGroupsTestJSON-302347413 tempest-SecurityGroupsTestJSON-302347413-project-member] Enqueued Resource ID: 2a4b01a6-74af-4232-8012-76435e07acca with Priority: HIGHEST for action security_group_members [ 935.293529] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGHEST for action security_group_members [ 935.293529] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcaf51d1-3d78-4731-8697-ec542f23f503 with Priority: HIGHEST for action security_group_members [ 935.293529] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a4b01a6-74af-4232-8012-76435e07acca with Priority: HIGHEST for action security_group_members [ 935.293790] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-69913569-f584-45f7-91a4-ec8af89769a9 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.293846] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.293883] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.294268] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.294268] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.294411] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.294411] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.294528] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.294614] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.294705] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.295832] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcaf51d1-3d78-4731-8697-ec542f23f503 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.295942] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.296015] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.296171] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.296311] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.296403] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.296464] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.296684] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.296684] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.296750] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dcaf51d1-3d78-4731-8697-ec542f23f503',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.297474] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a4b01a6-74af-4232-8012-76435e07acca taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.297567] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a4b01a6-74af-4232-8012-76435e07acca" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.297635] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a4b01a6-74af-4232-8012-76435e07acca" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.297809] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a4b01a6-74af-4232-8012-76435e07acca" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.297949] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.298130] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.298199] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.298341] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.298418] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.298499] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a4b01a6-74af-4232-8012-76435e07acca',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.682797] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.682965] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.683586] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.683586] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.683586] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.683586] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 is going to be updated. [ 935.737605] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.737776] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.737850] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.738109] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.738256] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.748922] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 in Status: IN_PROGRESS for 2s [ 935.800638] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.800790] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.800853] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.803017] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.803017] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.803017] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.803017] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.803017] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.823955] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.824265] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.824392] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.824471] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.824703] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.824790] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.824887] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69913569-f584-45f7-91a4-ec8af89769a9 is going to be updated. [ 935.826104] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.826301] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.853682] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.853943] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.854082] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.854152] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.854333] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.854416] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.854630] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcaf51d1-3d78-4731-8697-ec542f23f503 is going to be updated. [ 935.855552] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.855796] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.874899] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.874899] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.874899] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.874899] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.874899] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.882203] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.882558] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.882689] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.882755] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.882963] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.883057] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.883157] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a4b01a6-74af-4232-8012-76435e07acca is going to be updated. [ 935.890081] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69913569-f584-45f7-91a4-ec8af89769a9 in Status: IN_PROGRESS for 2s [ 935.896720] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.896908] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.896994] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.897786] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.897990] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.909396] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcaf51d1-3d78-4731-8697-ec542f23f503 in Status: IN_PROGRESS for 2s [ 935.931400] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.932824] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.932824] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.932824] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.932824] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.953681] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a4b01a6-74af-4232-8012-76435e07acca in Status: IN_PROGRESS for 2s [ 936.420743] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49023ece-127e-45b7-853d-a7309ff27819 in Status: SUCCESS [ 936.421407] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.421754] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.422126] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.422462] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.423821] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.423821] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.423821] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.423821] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.423821] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49023ece-127e-45b7-853d-a7309ff27819',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.927285] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.927285] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.927285] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.927285] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.953263] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.953263] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.953263] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.953263] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.953263] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.953263] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.953263] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49023ece-127e-45b7-853d-a7309ff27819 is going to be updated. [ 936.983326] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.983326] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.983326] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.983460] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.983499] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.992898] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49023ece-127e-45b7-853d-a7309ff27819 in Status: IN_PROGRESS for 2s [ 937.037213] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b127ff-135f-4cd2-9456-bc11d98737ce in Status: SUCCESS [ 937.037422] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9b127ff-135f-4cd2-9456-bc11d98737ce deletion is rescheduled due to dependency. [ 937.037518] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.153330] env[65943]: INFO networking_nsxv3.common.synchronization [req-daa7bfb5-73f7-47e9-bfb2-4d4e088c32ce req-539d2cb4-0d9c-4748-a6b8-b4a33bcf386b tempest-ImagesTestJSON-196343566 tempest-ImagesTestJSON-196343566-project-member] Enqueued Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_members [ 937.154222] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_members [ 937.154891] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c81f5e-9888-4914-ab90-42d06116db49 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.154891] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.154891] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.155124] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.155308] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.155415] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.155493] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.155710] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.155827] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.155960] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.662920] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.762580] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 in Status: SUCCESS [ 937.762793] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.762964] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.763222] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.763702] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.763702] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.763702] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.763871] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.763871] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.763954] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.764188] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7544afbe-03f8-421e-b9ed-b038f61ffc17',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.901118] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69913569-f584-45f7-91a4-ec8af89769a9 in Status: SUCCESS [ 937.901306] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69913569-f584-45f7-91a4-ec8af89769a9 deletion is rescheduled due to dependency. [ 937.901456] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.921793] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcaf51d1-3d78-4731-8697-ec542f23f503 in Status: SUCCESS [ 937.921932] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcaf51d1-3d78-4731-8697-ec542f23f503 deletion is rescheduled due to dependency. [ 937.921987] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.965077] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a4b01a6-74af-4232-8012-76435e07acca in Status: SUCCESS [ 937.965330] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a4b01a6-74af-4232-8012-76435e07acca deletion is rescheduled due to dependency. [ 937.965389] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a4b01a6-74af-4232-8012-76435e07acca" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.166219] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.267887] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7544afbe-03f8-421e-b9ed-b038f61ffc17',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.670071] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.670505] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.670505] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.670751] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.670897] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.671064] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c81f5e-9888-4914-ab90-42d06116db49 is going to be updated. [ 938.700934] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.701541] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.701670] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.701893] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.704021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.724190] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c81f5e-9888-4914-ab90-42d06116db49 in Status: IN_PROGRESS for 2s [ 938.771235] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7544afbe-03f8-421e-b9ed-b038f61ffc17: rpc.has_security_group_logging(os_id): False [ 938.791326] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.791469] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.791532] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.791745] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.814654] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.815087] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.815178] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.815214] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.815440] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.815544] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.815727] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 is going to be updated. [ 938.880416] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.880620] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.880709] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.880902] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.881062] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.897658] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 in Status: IN_PROGRESS for 2s [ 939.007066] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49023ece-127e-45b7-853d-a7309ff27819 in Status: SUCCESS [ 939.007422] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49023ece-127e-45b7-853d-a7309ff27819 deletion is rescheduled due to dependency. [ 939.007422] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.008015] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.008015] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.008015] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.008140] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.008227] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.008842] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.008842] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.008842] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.008842] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-49023ece-127e-45b7-853d-a7309ff27819 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.008842] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.008842] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.009128] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.009128] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.009229] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.009289] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.009426] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.009500] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.009581] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.009668] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49023ece-127e-45b7-853d-a7309ff27819',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.010938] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.010938] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.011163] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.011163] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.011286] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.011722] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.011722] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.011722] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49023ece-127e-45b7-853d-a7309ff27819',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.513722] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49023ece-127e-45b7-853d-a7309ff27819: rpc.has_security_group_logging(os_id): False [ 939.514802] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.515126] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.515320] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.515737] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.515944] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.516299] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.516490] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.516599] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.516848] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.516935] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.517386] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49023ece-127e-45b7-853d-a7309ff27819 is going to be updated. [ 939.537608] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.537608] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.537608] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.538687] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.538687] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.538687] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.538687] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.538687] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.538687] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.538980] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.539068] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.539196] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.539237] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.539388] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.539461] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.539723] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.539837] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.539906] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.540062] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.540135] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.540217] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49023ece-127e-45b7-853d-a7309ff27819 is going to be updated. [ 939.549603] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.549812] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.549812] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.551195] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.551195] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.564646] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49023ece-127e-45b7-853d-a7309ff27819 in Status: IN_PROGRESS for 2s [ 939.612218] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.612386] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.612458] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.612702] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.612857] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.626951] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49023ece-127e-45b7-853d-a7309ff27819 in Status: IN_PROGRESS for 2s [ 939.745490] env[65943]: INFO networking_nsxv3.common.synchronization [req-c58ce9ef-f0c9-4541-945d-d5ccf93f60d7 req-4d937d18-a129-4a06-bf49-7ff69b2e92c3 tempest-DeleteServersTestJSON-1404918926 tempest-DeleteServersTestJSON-1404918926-project-member] Enqueued Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_members [ 939.747429] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_members [ 939.748251] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.748401] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.748466] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.748691] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.748932] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.749175] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.749248] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.749378] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.749468] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.749573] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.252035] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.252294] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.252327] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.252567] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.280529] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.280529] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.280529] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.280529] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.280529] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.280529] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.280529] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 is going to be updated. [ 940.319331] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.319546] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.319697] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.319816] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.320079] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.332446] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: IN_PROGRESS for 2s [ 940.739172] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c81f5e-9888-4914-ab90-42d06116db49 in Status: SUCCESS [ 940.739172] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.829528] env[65943]: INFO networking_nsxv3.common.synchronization [req-db08c0e9-af13-4afd-a674-a8c8f3401627 req-c452f226-67e5-4f7b-9e89-cf478fad0436 tempest-ImagesOneServerNegativeTestJSON-477600040 tempest-ImagesOneServerNegativeTestJSON-477600040-project-member] Enqueued Resource ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d with Priority: HIGHEST for action security_group_members [ 940.830118] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d with Priority: HIGHEST for action security_group_members [ 940.831058] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b23ffb1-731f-42f8-bb4b-c106291be34d taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.831525] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.831525] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.831525] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.831772] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.834085] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.834085] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.834085] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.834085] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.834085] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b23ffb1-731f-42f8-bb4b-c106291be34d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.914670] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 in Status: SUCCESS [ 940.914914] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.235397] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-257 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.235614] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-257" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.235913] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-257" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.236496] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-257" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.236589] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.236773] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.236917] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.237187] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.237335] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.237555] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 941.239869] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 941.240042] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 941.240204] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 941.240427] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 941.240536] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 941.240721] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 941.268676] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 941.269058] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 941.269209] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 941.269502] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-257" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.269852] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-80fb4dfd-ddcd-4765-a205-84adeed04382 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.269996] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-80fb4dfd-ddcd-4765-a205-84adeed04382" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.270195] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-80fb4dfd-ddcd-4765-a205-84adeed04382" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.270588] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-80fb4dfd-ddcd-4765-a205-84adeed04382" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.270759] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80fb4dfd-ddcd-4765-a205-84adeed04382',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.334896] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.335170] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.335294] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.335692] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.364920] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.364920] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.365964] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.365964] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.365964] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.365964] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.366555] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d is going to be updated. [ 941.408665] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.409671] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.409671] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.409671] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.409671] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.422198] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d in Status: IN_PROGRESS for 2s [ 941.575573] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49023ece-127e-45b7-853d-a7309ff27819 in Status: SUCCESS [ 941.575573] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49023ece-127e-45b7-853d-a7309ff27819 deletion is rescheduled due to dependency. [ 941.575573] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.643040] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49023ece-127e-45b7-853d-a7309ff27819 in Status: SUCCESS [ 941.643193] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.643449] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.643908] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.644017] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49023ece-127e-45b7-853d-a7309ff27819',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.773938] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.774184] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.774362] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.774723] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.774924] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.775163] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port 80fb4dfd-ddcd-4765-a205-84adeed04382 not found, creating... [ 941.775477] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.775707] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.775877] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.776156] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.776327] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.776678] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.776865] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.777014] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.777271] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.777426] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.777603] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: 80fb4dfd-ddcd-4765-a205-84adeed04382 is going to be created. [ 941.798208] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.798445] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.798538] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.798865] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.799645] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.799645] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-80fb4dfd-ddcd-4765-a205-84adeed04382" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.167416] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.167803] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.167803] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.167888] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.167975] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.168086] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49023ece-127e-45b7-853d-a7309ff27819 is going to be deleted. [ 942.219990] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.219990] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.219990] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.219990] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.219990] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.220557] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49023ece-127e-45b7-853d-a7309ff27819" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.345386] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: SUCCESS [ 942.345603] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 deletion is rescheduled due to dependency. [ 942.345773] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.592136] env[65943]: INFO networking_nsxv3.common.synchronization [req-db08c0e9-af13-4afd-a674-a8c8f3401627 req-8c753239-3fd8-4469-b64c-0de4d858d688 service nova] Enqueued Resource ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d with Priority: HIGHEST for action security_group_rules [ 942.592327] env[65943]: INFO networking_nsxv3.common.synchronization [req-db08c0e9-af13-4afd-a674-a8c8f3401627 req-8c753239-3fd8-4469-b64c-0de4d858d688 service nova] Enqueued Resource ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d with Priority: HIGHEST for action security_group_members [ 942.592483] env[65943]: INFO networking_nsxv3.common.synchronization [req-db08c0e9-af13-4afd-a674-a8c8f3401627 req-8c753239-3fd8-4469-b64c-0de4d858d688 service nova] Enqueued Resource ID: 80fb4dfd-ddcd-4765-a205-84adeed04382 with Priority: HIGHEST for action port [ 942.593055] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d with Priority: HIGHEST for action security_group_rules [ 942.594525] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d with Priority: HIGHEST for action security_group_members [ 942.594525] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80fb4dfd-ddcd-4765-a205-84adeed04382 with Priority: HIGHEST for action port [ 942.594525] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b23ffb1-731f-42f8-bb4b-c106291be34d taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.594525] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.594525] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.594525] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.594525] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b23ffb1-731f-42f8-bb4b-c106291be34d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.595323] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b23ffb1-731f-42f8-bb4b-c106291be34d taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.595414] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.595601] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-80fb4dfd-ddcd-4765-a205-84adeed04382 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.595719] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-80fb4dfd-ddcd-4765-a205-84adeed04382" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.595808] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-80fb4dfd-ddcd-4765-a205-84adeed04382" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.595996] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-80fb4dfd-ddcd-4765-a205-84adeed04382" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.596090] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80fb4dfd-ddcd-4765-a205-84adeed04382',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.097975] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b23ffb1-731f-42f8-bb4b-c106291be34d taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.098193] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.102749] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 80fb4dfd-ddcd-4765-a205-84adeed04382 with status ACTIVE [ 943.102920] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.103073] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.103173] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.103360] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.103454] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.103628] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.103727] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.103791] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.103961] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.104050] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.104233] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.104328] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.104389] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.104545] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.104618] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.104689] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 80fb4dfd-ddcd-4765-a205-84adeed04382 is going to be updated. [ 943.130330] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.131607] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.131607] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.131607] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.131607] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.131607] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-80fb4dfd-ddcd-4765-a205-84adeed04382" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.435453] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d in Status: SUCCESS [ 943.435453] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d deletion is rescheduled due to dependency. [ 943.435453] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.435453] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.435453] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.435453] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.435453] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.435453] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.435453] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.435453] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.435453] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b23ffb1-731f-42f8-bb4b-c106291be34d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.568505] env[65943]: INFO networking_nsxv3.common.synchronization [req-db00d272-1e79-4793-aed0-b0133330d69b req-a3dad9f1-cc73-4e49-bcf8-872d65cdf09c tempest-MultipleCreateTestJSON-697980507 tempest-MultipleCreateTestJSON-697980507-project-member] Enqueued Resource ID: f5a629bb-fe88-498c-a120-35da2e141a08 with Priority: HIGHEST for action security_group_members [ 943.572021] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5a629bb-fe88-498c-a120-35da2e141a08 with Priority: HIGHEST for action security_group_members [ 943.572021] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5a629bb-fe88-498c-a120-35da2e141a08 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.572021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.572021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.572021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.572021] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.572021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.572021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.572021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.572021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.572021] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.939686] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4b23ffb1-731f-42f8-bb4b-c106291be34d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.006083] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-690 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.006993] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-690" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.006993] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-690" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.006993] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-690" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.007187] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.007451] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.007575] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.007834] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.007984] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.008231] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 944.008913] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 944.008913] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 944.008913] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 944.008913] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 944.008913] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 944.009837] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 944.035240] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 944.035421] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 944.035558] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 944.035831] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-690" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.036179] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-91f32dc8-a96f-4eaf-9154-f6c80af760df taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.036355] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-91f32dc8-a96f-4eaf-9154-f6c80af760df" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.036472] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-91f32dc8-a96f-4eaf-9154-f6c80af760df" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.036788] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-91f32dc8-a96f-4eaf-9154-f6c80af760df" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.036931] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91f32dc8-a96f-4eaf-9154-f6c80af760df',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.080151] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.080532] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.080738] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.081065] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.107046] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.107046] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.107046] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.107046] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.107046] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.107046] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.107348] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5a629bb-fe88-498c-a120-35da2e141a08 is going to be updated. [ 944.139497] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.140556] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.141506] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.141889] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.142099] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.152751] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5a629bb-fe88-498c-a120-35da2e141a08 in Status: IN_PROGRESS for 2s [ 944.442663] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4b23ffb1-731f-42f8-bb4b-c106291be34d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.543243] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.543545] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.543706] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.544085] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.544303] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.544488] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port 91f32dc8-a96f-4eaf-9154-f6c80af760df not found, creating... [ 944.544782] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.545079] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.545179] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.545469] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.545632] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.545969] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.546147] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.546316] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.546544] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.546681] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.546823] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: 91f32dc8-a96f-4eaf-9154-f6c80af760df is going to be created. [ 944.572856] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.573209] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.573592] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.573853] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.574147] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.575245] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-91f32dc8-a96f-4eaf-9154-f6c80af760df" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.946079] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.946079] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.946079] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.946441] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.946602] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.946753] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d is going to be updated. [ 944.983851] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.984182] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.984182] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.984321] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.984412] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.994520] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d in Status: IN_PROGRESS for 2s [ 945.275090] env[65943]: INFO networking_nsxv3.common.synchronization [req-db00d272-1e79-4793-aed0-b0133330d69b req-057901c5-8e3c-4450-b66d-808945e89f7c service nova] Enqueued Resource ID: f5a629bb-fe88-498c-a120-35da2e141a08 with Priority: HIGHEST for action security_group_rules [ 945.275264] env[65943]: INFO networking_nsxv3.common.synchronization [req-db00d272-1e79-4793-aed0-b0133330d69b req-057901c5-8e3c-4450-b66d-808945e89f7c service nova] Enqueued Resource ID: f5a629bb-fe88-498c-a120-35da2e141a08 with Priority: HIGHEST for action security_group_members [ 945.275407] env[65943]: INFO networking_nsxv3.common.synchronization [req-db00d272-1e79-4793-aed0-b0133330d69b req-057901c5-8e3c-4450-b66d-808945e89f7c service nova] Enqueued Resource ID: 91f32dc8-a96f-4eaf-9154-f6c80af760df with Priority: HIGHEST for action port [ 945.276111] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5a629bb-fe88-498c-a120-35da2e141a08 with Priority: HIGHEST for action security_group_rules [ 945.276111] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5a629bb-fe88-498c-a120-35da2e141a08 with Priority: HIGHEST for action security_group_members [ 945.276246] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91f32dc8-a96f-4eaf-9154-f6c80af760df with Priority: HIGHEST for action port [ 945.276519] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5a629bb-fe88-498c-a120-35da2e141a08 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.276621] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.276670] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.276854] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.276938] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.283815] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5a629bb-fe88-498c-a120-35da2e141a08 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.283941] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.284193] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-91f32dc8-a96f-4eaf-9154-f6c80af760df taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.284315] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91f32dc8-a96f-4eaf-9154-f6c80af760df" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.284413] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91f32dc8-a96f-4eaf-9154-f6c80af760df" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.284557] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91f32dc8-a96f-4eaf-9154-f6c80af760df" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.284646] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91f32dc8-a96f-4eaf-9154-f6c80af760df',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.788789] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5a629bb-fe88-498c-a120-35da2e141a08 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.789309] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.789309] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 91f32dc8-a96f-4eaf-9154-f6c80af760df with status ACTIVE [ 945.789700] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.789903] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.790023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.790383] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.790530] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.790745] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.790922] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.791685] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.791685] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.791685] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.791685] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.791935] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.791935] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.792069] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.792175] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.793258] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 91f32dc8-a96f-4eaf-9154-f6c80af760df is going to be updated. [ 945.854282] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.854482] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.855207] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.855207] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.855343] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.855546] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91f32dc8-a96f-4eaf-9154-f6c80af760df" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.157328] env[65943]: INFO networking_nsxv3.common.synchronization [req-db00d272-1e79-4793-aed0-b0133330d69b req-4858a943-4ccd-4cc1-b4c8-768c56373118 tempest-MultipleCreateTestJSON-697980507 tempest-MultipleCreateTestJSON-697980507-project-member] Enqueued Resource ID: f5a629bb-fe88-498c-a120-35da2e141a08 with Priority: HIGHEST for action security_group_members [ 946.158029] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5a629bb-fe88-498c-a120-35da2e141a08 with Priority: HIGHEST for action security_group_members [ 946.158374] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5a629bb-fe88-498c-a120-35da2e141a08 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.158516] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.163574] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5a629bb-fe88-498c-a120-35da2e141a08 in Status: SUCCESS [ 946.163790] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5a629bb-fe88-498c-a120-35da2e141a08 deletion is rescheduled due to dependency. [ 946.163925] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.164132] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.164378] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.164590] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.164719] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.164801] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.164976] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.165087] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.165189] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.563732] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-690 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.563958] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-690" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.568027] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-690" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.568027] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-690" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.568027] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.568027] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.568027] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.568027] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.568027] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.568027] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 946.568027] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 946.568027] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 946.568027] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 946.568027] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 946.568027] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 946.568027] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 946.588136] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 946.588320] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 946.588531] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 946.588671] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-690" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.588954] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-f8413334-a024-485f-b758-99b8f31aab3c taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.589196] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-f8413334-a024-485f-b758-99b8f31aab3c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.589266] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-f8413334-a024-485f-b758-99b8f31aab3c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.589608] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-f8413334-a024-485f-b758-99b8f31aab3c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.589779] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8413334-a024-485f-b758-99b8f31aab3c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.669488] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.009051] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d in Status: SUCCESS [ 947.009051] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.009051] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.009051] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.009051] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.009051] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.009051] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.009051] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.009051] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.009051] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.009051] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4b23ffb1-731f-42f8-bb4b-c106291be34d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.092437] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.092699] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.092830] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.093213] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.093398] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.093611] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port f8413334-a024-485f-b758-99b8f31aab3c not found, creating... [ 947.093943] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.094161] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.094315] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.094584] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.094761] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.095861] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.096136] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.096310] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.096677] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.096882] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.097414] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: f8413334-a024-485f-b758-99b8f31aab3c is going to be created. [ 947.121970] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.122266] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.122433] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.122783] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.123125] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.123428] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-f8413334-a024-485f-b758-99b8f31aab3c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.173118] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.512112] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b23ffb1-731f-42f8-bb4b-c106291be34d taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.512385] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.512448] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.512765] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.512950] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.513100] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.513197] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.513426] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.513571] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.513702] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.513889] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b23ffb1-731f-42f8-bb4b-c106291be34d taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.514044] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.514121] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.514300] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.514472] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.514641] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.514731] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.514923] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.515324] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.515611] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.515757] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4b23ffb1-731f-42f8-bb4b-c106291be34d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.680372] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.680618] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.680858] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.681040] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.681172] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.681334] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5a629bb-fe88-498c-a120-35da2e141a08 is going to be updated. [ 947.719514] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.719838] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.719985] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.720392] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.723114] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.732034] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5a629bb-fe88-498c-a120-35da2e141a08 in Status: IN_PROGRESS for 2s [ 947.924342] env[65943]: INFO networking_nsxv3.common.synchronization [req-db00d272-1e79-4793-aed0-b0133330d69b req-63b45125-1f50-4b7e-8efe-078a76356818 service nova] Enqueued Resource ID: f5a629bb-fe88-498c-a120-35da2e141a08 with Priority: HIGHEST for action security_group_rules [ 947.924342] env[65943]: INFO networking_nsxv3.common.synchronization [req-db00d272-1e79-4793-aed0-b0133330d69b req-63b45125-1f50-4b7e-8efe-078a76356818 service nova] Enqueued Resource ID: f5a629bb-fe88-498c-a120-35da2e141a08 with Priority: HIGHEST for action security_group_members [ 947.924342] env[65943]: INFO networking_nsxv3.common.synchronization [req-db00d272-1e79-4793-aed0-b0133330d69b req-63b45125-1f50-4b7e-8efe-078a76356818 service nova] Enqueued Resource ID: f8413334-a024-485f-b758-99b8f31aab3c with Priority: HIGHEST for action port [ 947.928284] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5a629bb-fe88-498c-a120-35da2e141a08 with Priority: HIGHEST for action security_group_rules [ 947.928284] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5a629bb-fe88-498c-a120-35da2e141a08 with Priority: HIGHEST for action security_group_members [ 947.928284] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8413334-a024-485f-b758-99b8f31aab3c with Priority: HIGHEST for action port [ 947.928284] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5a629bb-fe88-498c-a120-35da2e141a08 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.928284] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.928284] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5a629bb-fe88-498c-a120-35da2e141a08 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.928284] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.928284] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8413334-a024-485f-b758-99b8f31aab3c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.928284] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8413334-a024-485f-b758-99b8f31aab3c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.928284] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8413334-a024-485f-b758-99b8f31aab3c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.928284] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8413334-a024-485f-b758-99b8f31aab3c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.928284] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8413334-a024-485f-b758-99b8f31aab3c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.019028] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4b23ffb1-731f-42f8-bb4b-c106291be34d: rpc.has_security_group_logging(os_id): False [ 948.044753] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.045028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.045028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.045335] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.045465] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.045966] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.046291] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.046291] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.046549] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.046704] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.047126] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.047325] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.047456] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.047772] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.047872] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.048166] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.048376] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.048453] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.048690] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.048801] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.048952] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d is going to be updated. [ 948.123525] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.123685] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.123742] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.123942] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.124292] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.143503] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d in Status: IN_PROGRESS for 2s [ 948.436617] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f8413334-a024-485f-b758-99b8f31aab3c with status ACTIVE [ 948.436944] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.437103] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.437169] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.437398] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.437492] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.437705] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.437903] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.438011] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.438226] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.438311] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.438507] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.438608] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.438717] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.438884] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.438983] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.439091] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f8413334-a024-485f-b758-99b8f31aab3c is going to be updated. [ 948.469162] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.469364] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.469405] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.469710] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.469841] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.469974] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8413334-a024-485f-b758-99b8f31aab3c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.561712] env[65943]: INFO networking_nsxv3.common.synchronization [req-56b79c2e-306f-48c3-95f5-e6f7d4df83ed req-a5f2fdb1-6356-4185-88dd-465ce244da9d tempest-ServersWithSpecificFlavorTestJSON-110328110 tempest-ServersWithSpecificFlavorTestJSON-110328110-project-member] Enqueued Resource ID: b88e0956-a799-4c5e-8e71-323151811fd1 with Priority: HIGHEST for action security_group_members [ 949.562265] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b88e0956-a799-4c5e-8e71-323151811fd1 with Priority: HIGHEST for action security_group_members [ 949.562563] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b88e0956-a799-4c5e-8e71-323151811fd1 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.562709] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.562755] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.563046] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.563119] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.563178] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.563240] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.563375] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.563463] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.563557] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b88e0956-a799-4c5e-8e71-323151811fd1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.749739] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5a629bb-fe88-498c-a120-35da2e141a08 in Status: SUCCESS [ 949.750100] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.750274] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.750500] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.750709] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.750835] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.750937] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.751093] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.751167] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.751247] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.751348] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.753529] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.753810] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.754095] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.754280] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.754389] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.754572] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.754663] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.754764] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.852680] env[65943]: INFO networking_nsxv3.common.synchronization [req-0f623a10-ad9d-4258-94c6-ee9861fe7bc1 req-1d4b8eff-61aa-4a2e-aa79-e695ac43d76b tempest-ServerGroupTestJSON-2061673576 tempest-ServerGroupTestJSON-2061673576-project-member] Enqueued Resource ID: ee79fa8c-44ea-481b-acf3-ba71ab1ad09a with Priority: HIGHEST for action security_group_members [ 949.853448] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee79fa8c-44ea-481b-acf3-ba71ab1ad09a with Priority: HIGHEST for action security_group_members [ 949.853543] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.853647] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.853729] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.853988] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.854198] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.854436] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.854436] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.854559] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.854653] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.854749] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee79fa8c-44ea-481b-acf3-ba71ab1ad09a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.066106] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.066350] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.066350] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.066607] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.091853] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.092694] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.092694] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.092899] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.093247] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.093406] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.093561] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b88e0956-a799-4c5e-8e71-323151811fd1 is going to be updated. [ 950.129955] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.130244] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.130244] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.130599] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.130781] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.142331] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b88e0956-a799-4c5e-8e71-323151811fd1 in Status: IN_PROGRESS for 2s [ 950.164804] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d in Status: SUCCESS [ 950.165124] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.227469] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-924 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.227685] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-924" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.227914] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-924" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.228277] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-924" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.228557] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.228721] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.228847] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.232215] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.234023] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.234023] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 950.234023] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 950.234023] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 950.234023] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 950.234023] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 950.234023] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 950.234023] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 950.256833] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 950.257157] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 950.257280] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 950.257578] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-924" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.258200] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-47f3b8c0-b08d-44d4-a936-f4d87186382c taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.258422] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-47f3b8c0-b08d-44d4-a936-f4d87186382c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.258542] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-47f3b8c0-b08d-44d4-a936-f4d87186382c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.258877] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-47f3b8c0-b08d-44d4-a936-f4d87186382c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.259107] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47f3b8c0-b08d-44d4-a936-f4d87186382c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.260233] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5a629bb-fe88-498c-a120-35da2e141a08 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.260466] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.261304] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.358716] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.358932] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.358932] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.359174] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.359293] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.359501] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.359602] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.359660] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.359833] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.359911] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.359999] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee79fa8c-44ea-481b-acf3-ba71ab1ad09a already deleted. [ 950.360123] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.764080] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.764573] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.764791] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.765229] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.765498] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.765708] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port 47f3b8c0-b08d-44d4-a936-f4d87186382c not found, creating... [ 950.767058] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.767058] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.767058] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.767058] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.767058] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.767987] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.768343] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.768674] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.769124] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.769427] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.769738] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: 47f3b8c0-b08d-44d4-a936-f4d87186382c is going to be created. [ 950.771635] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.795953] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.796256] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.796431] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.796876] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.797177] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.797571] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-47f3b8c0-b08d-44d4-a936-f4d87186382c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.275703] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.275958] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.276091] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.276447] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.276611] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.277026] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5a629bb-fe88-498c-a120-35da2e141a08 is going to be updated. [ 951.321685] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.321954] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.322068] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.322353] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.322554] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.336053] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5a629bb-fe88-498c-a120-35da2e141a08 in Status: IN_PROGRESS for 2s [ 951.582770] env[65943]: INFO networking_nsxv3.common.synchronization [req-0a039da4-7510-44f9-9c93-1bd475ed04f2 req-a14dddda-1d30-41b0-9449-fa09a1625f42 tempest-ServerDiskConfigTestJSON-397438939 tempest-ServerDiskConfigTestJSON-397438939-project-member] Enqueued Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_members [ 951.583654] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_members [ 951.583975] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b127ff-135f-4cd2-9456-bc11d98737ce taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.584428] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.584517] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.584716] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.585050] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.585179] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.585246] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.585480] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.585653] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.585777] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.611481] env[65943]: INFO networking_nsxv3.common.synchronization [req-0f623a10-ad9d-4258-94c6-ee9861fe7bc1 req-9e51c041-f80a-42c5-90cb-981f561edc4e service nova] Enqueued Resource ID: ee79fa8c-44ea-481b-acf3-ba71ab1ad09a with Priority: HIGHEST for action security_group_rules [ 951.611752] env[65943]: INFO networking_nsxv3.common.synchronization [req-0f623a10-ad9d-4258-94c6-ee9861fe7bc1 req-9e51c041-f80a-42c5-90cb-981f561edc4e service nova] Enqueued Resource ID: ee79fa8c-44ea-481b-acf3-ba71ab1ad09a with Priority: HIGHEST for action security_group_members [ 951.611906] env[65943]: INFO networking_nsxv3.common.synchronization [req-0f623a10-ad9d-4258-94c6-ee9861fe7bc1 req-9e51c041-f80a-42c5-90cb-981f561edc4e service nova] Enqueued Resource ID: 47f3b8c0-b08d-44d4-a936-f4d87186382c with Priority: HIGHEST for action port [ 951.617831] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee79fa8c-44ea-481b-acf3-ba71ab1ad09a with Priority: HIGHEST for action security_group_rules [ 951.617831] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee79fa8c-44ea-481b-acf3-ba71ab1ad09a with Priority: HIGHEST for action security_group_members [ 951.617831] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47f3b8c0-b08d-44d4-a936-f4d87186382c with Priority: HIGHEST for action port [ 951.617831] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.618178] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.618178] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.618290] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.618381] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee79fa8c-44ea-481b-acf3-ba71ab1ad09a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.622557] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.622750] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.622750] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.622967] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.624442] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.624442] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.624442] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.624442] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.624442] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.624442] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee79fa8c-44ea-481b-acf3-ba71ab1ad09a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.624980] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-47f3b8c0-b08d-44d4-a936-f4d87186382c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.624980] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47f3b8c0-b08d-44d4-a936-f4d87186382c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.624980] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47f3b8c0-b08d-44d4-a936-f4d87186382c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.624980] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47f3b8c0-b08d-44d4-a936-f4d87186382c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.624980] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47f3b8c0-b08d-44d4-a936-f4d87186382c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.088591] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.088591] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.088591] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.089202] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.089202] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.089659] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.089659] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.089659] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.089865] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.089865] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.090039] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9b127ff-135f-4cd2-9456-bc11d98737ce is going to be updated. [ 952.097489] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-327 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.098114] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-327" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.098639] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-327" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.099170] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-327" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.099659] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.099999] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.100535] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.100996] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.100996] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.101550] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 952.101687] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 952.101803] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 952.101952] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 952.102088] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 952.102202] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 952.102366] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 952.123992] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.124204] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.127407] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 952.127588] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 952.127715] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 952.128019] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-327" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.128776] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-78ce7772-0fe5-44da-a5b4-b44479208908 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.128776] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-78ce7772-0fe5-44da-a5b4-b44479208908" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.128776] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-78ce7772-0fe5-44da-a5b4-b44479208908" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.129184] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-78ce7772-0fe5-44da-a5b4-b44479208908" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.129510] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78ce7772-0fe5-44da-a5b4-b44479208908',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.130451] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee79fa8c-44ea-481b-acf3-ba71ab1ad09a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.131968] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 47f3b8c0-b08d-44d4-a936-f4d87186382c with status ACTIVE [ 952.131968] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.132217] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.132217] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.132396] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.132546] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.132706] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.132796] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.132830] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.132990] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.133084] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.133370] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.133502] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.133663] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.133874] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.134073] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.134203] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 47f3b8c0-b08d-44d4-a936-f4d87186382c is going to be updated. [ 952.136411] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.136554] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.136675] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.136759] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.136894] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.153233] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b127ff-135f-4cd2-9456-bc11d98737ce in Status: IN_PROGRESS for 2s [ 952.155579] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b88e0956-a799-4c5e-8e71-323151811fd1 in Status: SUCCESS [ 952.156079] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b88e0956-a799-4c5e-8e71-323151811fd1 deletion is rescheduled due to dependency. [ 952.156215] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b88e0956-a799-4c5e-8e71-323151811fd1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.170192] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.170413] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.170482] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.171062] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.171167] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.171333] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47f3b8c0-b08d-44d4-a936-f4d87186382c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.636485] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.636700] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.636848] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.637252] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.637440] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.637563] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port 78ce7772-0fe5-44da-a5b4-b44479208908 not found, creating... [ 952.637896] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.638084] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.638232] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.638528] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.638632] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.638939] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.639130] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.639248] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.639460] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.639644] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.639811] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: 78ce7772-0fe5-44da-a5b4-b44479208908 is going to be created. [ 952.640934] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee79fa8c-44ea-481b-acf3-ba71ab1ad09a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.671626] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.671868] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.672039] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.672318] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.672560] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.672795] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-78ce7772-0fe5-44da-a5b4-b44479208908" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.144019] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.144367] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.144367] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.144772] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.144910] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.145039] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee79fa8c-44ea-481b-acf3-ba71ab1ad09a is going to be created. [ 953.172374] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.172568] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.172685] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.172953] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.173345] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.188050] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee79fa8c-44ea-481b-acf3-ba71ab1ad09a in Status: UNINITIALIZED for 2s [ 953.347461] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5a629bb-fe88-498c-a120-35da2e141a08 in Status: SUCCESS [ 953.348405] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.350019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.350019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.350019] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.350019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.350019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.350019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.350019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.350019] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.416178] env[65943]: INFO networking_nsxv3.common.synchronization [req-0a039da4-7510-44f9-9c93-1bd475ed04f2 req-28e6506c-b7d0-4710-b944-55a99d97350a service nova] Enqueued Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_rules [ 953.416330] env[65943]: INFO networking_nsxv3.common.synchronization [req-0a039da4-7510-44f9-9c93-1bd475ed04f2 req-28e6506c-b7d0-4710-b944-55a99d97350a service nova] Enqueued Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_members [ 953.416452] env[65943]: INFO networking_nsxv3.common.synchronization [req-0a039da4-7510-44f9-9c93-1bd475ed04f2 req-28e6506c-b7d0-4710-b944-55a99d97350a service nova] Enqueued Resource ID: 78ce7772-0fe5-44da-a5b4-b44479208908 with Priority: HIGHEST for action port [ 953.417276] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_rules [ 953.417432] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_members [ 953.417558] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78ce7772-0fe5-44da-a5b4-b44479208908 with Priority: HIGHEST for action port [ 953.417870] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9b127ff-135f-4cd2-9456-bc11d98737ce taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.418026] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.418119] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.418301] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.418392] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.419341] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b127ff-135f-4cd2-9456-bc11d98737ce taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.419479] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.419711] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-78ce7772-0fe5-44da-a5b4-b44479208908 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.419874] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78ce7772-0fe5-44da-a5b4-b44479208908" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.420101] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78ce7772-0fe5-44da-a5b4-b44479208908" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.420236] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78ce7772-0fe5-44da-a5b4-b44479208908" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.420236] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78ce7772-0fe5-44da-a5b4-b44479208908',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.853321] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.924499] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 78ce7772-0fe5-44da-a5b4-b44479208908 with status ACTIVE [ 953.924499] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.924499] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.924499] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.924841] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.924841] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.924963] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.925080] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.925133] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.925286] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.925361] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.925543] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.925782] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.925782] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.925872] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.925915] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.925990] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 78ce7772-0fe5-44da-a5b4-b44479208908 is going to be updated. [ 953.927475] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b127ff-135f-4cd2-9456-bc11d98737ce taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.927583] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.955441] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.955662] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.955770] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.956060] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.956218] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.956644] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78ce7772-0fe5-44da-a5b4-b44479208908" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.164448] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b127ff-135f-4cd2-9456-bc11d98737ce in Status: SUCCESS [ 954.164770] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9b127ff-135f-4cd2-9456-bc11d98737ce deletion is rescheduled due to dependency. [ 954.164770] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.165395] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.165626] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.165878] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.166027] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.166087] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.166266] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.166338] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.166440] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.355882] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.668736] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.858602] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.858720] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.858793] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.859527] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.859527] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.859527] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5a629bb-fe88-498c-a120-35da2e141a08 is going to be updated. [ 954.893186] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.893334] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.893403] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.893607] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.893752] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.905249] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5a629bb-fe88-498c-a120-35da2e141a08 in Status: IN_PROGRESS for 2s [ 955.172792] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.197673] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee79fa8c-44ea-481b-acf3-ba71ab1ad09a in Status: SUCCESS [ 955.197928] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.198140] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.198352] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.198546] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.198680] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.198802] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.198961] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.199070] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.199162] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.199258] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ee79fa8c-44ea-481b-acf3-ba71ab1ad09a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.676198] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.676443] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.676574] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.676871] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.676950] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.677201] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9b127ff-135f-4cd2-9456-bc11d98737ce is going to be updated. [ 955.702877] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.703208] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.703208] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.703601] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.703712] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.703822] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.703822] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.704087] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.704166] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.704235] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.704366] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.704471] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.704546] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.704660] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.704880] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.704880] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.704880] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.705535] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.705535] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.705535] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.705535] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ee79fa8c-44ea-481b-acf3-ba71ab1ad09a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.728746] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.728983] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.728983] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.729267] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.729469] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.748328] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b127ff-135f-4cd2-9456-bc11d98737ce in Status: IN_PROGRESS for 2s [ 956.208638] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ee79fa8c-44ea-481b-acf3-ba71ab1ad09a: rpc.has_security_group_logging(os_id): False [ 956.231010] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.231255] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.231255] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.231501] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.231629] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.231898] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.232069] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.232181] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.232403] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.232528] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.232780] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.232929] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.233040] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.233241] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.233358] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.233602] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.233746] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.233844] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.234063] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.234189] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.234325] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee79fa8c-44ea-481b-acf3-ba71ab1ad09a is going to be created. [ 956.303154] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.303452] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.303570] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.303860] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.304115] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.318171] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee79fa8c-44ea-481b-acf3-ba71ab1ad09a in Status: IN_PROGRESS for 2s [ 956.918593] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5a629bb-fe88-498c-a120-35da2e141a08 in Status: SUCCESS [ 956.918593] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.918593] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.918593] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.918593] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.918593] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.918593] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.918593] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.918593] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.919670] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.919670] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5a629bb-fe88-498c-a120-35da2e141a08 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.919670] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.919670] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.919670] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.919670] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.919670] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.920096] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.920096] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.920096] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.920200] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.920280] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.976616] env[65943]: INFO networking_nsxv3.common.synchronization [req-082ef15f-090a-40d4-b43a-6cb069207877 req-0d01b803-bfe8-4642-9df8-86bd6fe771da tempest-ImagesOneServerNegativeTestJSON-477600040 tempest-ImagesOneServerNegativeTestJSON-477600040-project-member] Enqueued Resource ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d with Priority: HIGHEST for action security_group_members [ 956.977779] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d with Priority: HIGHEST for action security_group_members [ 956.979221] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b23ffb1-731f-42f8-bb4b-c106291be34d taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.980448] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.980448] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.980448] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.980448] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.980448] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.980448] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.980448] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.980448] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.980855] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b23ffb1-731f-42f8-bb4b-c106291be34d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.423473] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5a629bb-fe88-498c-a120-35da2e141a08: rpc.has_security_group_logging(os_id): False [ 957.448567] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.448773] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.449023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.449159] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.449260] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.449540] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.449669] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.449669] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.449843] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.449939] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.450150] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.450249] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.450303] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.450449] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.450539] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.450768] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.450874] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.450942] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.451103] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.451181] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.451270] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5a629bb-fe88-498c-a120-35da2e141a08 is going to be updated. [ 957.487972] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.488160] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.488232] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.488450] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.488546] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.488747] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.488849] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.488911] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.489088] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.489168] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.489256] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d is going to be updated. [ 957.521746] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.521910] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.521956] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.523231] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.523231] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.535588] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d in Status: IN_PROGRESS for 2s [ 957.543575] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.543575] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.543575] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.543575] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.543890] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.567748] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5a629bb-fe88-498c-a120-35da2e141a08 in Status: IN_PROGRESS for 2s [ 957.763432] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b127ff-135f-4cd2-9456-bc11d98737ce in Status: SUCCESS [ 957.763655] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.763945] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.764272] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.764495] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.764678] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.764721] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.764964] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.765070] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.765181] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.765281] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.267868] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b127ff-135f-4cd2-9456-bc11d98737ce taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.268100] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.268144] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.268519] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.268719] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.268842] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.268914] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.269122] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.269250] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.269337] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.269514] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b127ff-135f-4cd2-9456-bc11d98737ce taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.269608] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.269663] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.269813] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.269975] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.270209] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.270209] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.270390] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.270459] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.270567] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.270664] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.330981] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee79fa8c-44ea-481b-acf3-ba71ab1ad09a in Status: SUCCESS [ 958.331611] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.773656] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9b127ff-135f-4cd2-9456-bc11d98737ce: rpc.has_security_group_logging(os_id): False [ 958.803756] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.803756] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.803756] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.804053] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.804053] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.804218] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.804296] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.804346] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.804517] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.804812] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.805305] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.805436] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.805538] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.805811] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.806039] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.806270] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.806421] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.806560] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.806755] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.806870] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.806972] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9b127ff-135f-4cd2-9456-bc11d98737ce is going to be updated. [ 959.008466] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.008679] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.008784] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.009218] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.009280] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.036682] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9b127ff-135f-4cd2-9456-bc11d98737ce in Status: IN_PROGRESS for 2s [ 959.549948] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d in Status: SUCCESS [ 959.550260] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d deletion is rescheduled due to dependency. [ 959.550460] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.599961] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5a629bb-fe88-498c-a120-35da2e141a08 in Status: SUCCESS [ 959.600317] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.600435] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.600646] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.600750] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.103634] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5a629bb-fe88-498c-a120-35da2e141a08 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.104203] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.104203] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.104203] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.104203] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.104445] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.104445] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.104445] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.104562] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.104636] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.104727] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.607607] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5a629bb-fe88-498c-a120-35da2e141a08 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.609124] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.609307] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.609567] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.610052] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.610052] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.610052] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.610233] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.610605] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.611139] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.611139] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5a629bb-fe88-498c-a120-35da2e141a08 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.611139] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.611139] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.611421] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.611545] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.611745] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.611745] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.611924] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.612026] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.612157] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.612273] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.693031] env[65943]: INFO networking_nsxv3.common.synchronization [req-18b50032-ae5d-48b2-a9c5-15a831f3ce94 req-5c5cf3d1-2ead-4e53-baad-f21e29e67a8b tempest-MultipleCreateTestJSON-697980507 tempest-MultipleCreateTestJSON-697980507-project-member] Enqueued Resource ID: f5a629bb-fe88-498c-a120-35da2e141a08 with Priority: HIGHEST for action security_group_members [ 960.693031] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5a629bb-fe88-498c-a120-35da2e141a08 with Priority: HIGHEST for action security_group_members [ 960.693549] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5a629bb-fe88-498c-a120-35da2e141a08 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.693549] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.693549] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.693698] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.694992] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.694992] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.694992] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.694992] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.694992] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.694992] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.027785] env[65943]: INFO networking_nsxv3.common.synchronization [req-014b81af-01f0-4995-a146-f4532c47f439 req-f7482d6c-5207-4916-a7fa-f091fa163224 tempest-MultipleCreateTestJSON-697980507 tempest-MultipleCreateTestJSON-697980507-project-member] Enqueued Resource ID: f5a629bb-fe88-498c-a120-35da2e141a08 with Priority: HIGHEST for action security_group_members [ 961.028518] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5a629bb-fe88-498c-a120-35da2e141a08 with Priority: HIGHEST for action security_group_members [ 961.028997] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5a629bb-fe88-498c-a120-35da2e141a08 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.029130] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.055836] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9b127ff-135f-4cd2-9456-bc11d98737ce in Status: SUCCESS [ 961.056207] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.114567] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5a629bb-fe88-498c-a120-35da2e141a08: rpc.has_security_group_logging(os_id): False [ 961.135859] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.138021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.138021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.138021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.138021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.138021] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.138021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.138021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.138021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.138021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.138021] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.138021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.138021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.138661] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.138840] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.139146] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.139355] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.139538] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.139808] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.140294] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.140484] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5a629bb-fe88-498c-a120-35da2e141a08 is going to be updated. [ 961.198590] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.214514] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.214761] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.214837] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.215069] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.215256] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.280818] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5a629bb-fe88-498c-a120-35da2e141a08 in Status: IN_PROGRESS for 2s [ 961.299676] env[65943]: INFO networking_nsxv3.common.synchronization [req-f7f1d2af-16e0-40c0-bf5c-d35405e5bbdb req-8d0a8677-d6fe-4025-a231-ad789bd54e69 tempest-ImagesTestJSON-196343566 tempest-ImagesTestJSON-196343566-project-member] Enqueued Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_members [ 961.300277] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_members [ 961.303937] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c81f5e-9888-4914-ab90-42d06116db49 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.304132] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.304203] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.304422] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.304596] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.304692] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.304750] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.304895] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.304979] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.305090] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.701388] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.809766] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.809975] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.810114] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.810454] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.837020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.837419] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.837574] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.837682] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.837975] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.838107] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.838219] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c81f5e-9888-4914-ab90-42d06116db49 is going to be updated. [ 961.867538] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.867694] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.867776] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.868111] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.868254] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.881730] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c81f5e-9888-4914-ab90-42d06116db49 in Status: IN_PROGRESS for 2s [ 962.204080] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.204525] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.204525] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.204683] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.204880] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.204979] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5a629bb-fe88-498c-a120-35da2e141a08 is going to be updated. [ 962.241577] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.241843] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.241920] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.242210] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.242366] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.253383] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5a629bb-fe88-498c-a120-35da2e141a08 in Status: IN_PROGRESS for 2s [ 963.299915] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5a629bb-fe88-498c-a120-35da2e141a08 in Status: SUCCESS [ 963.299915] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.894163] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c81f5e-9888-4914-ab90-42d06116db49 in Status: SUCCESS [ 963.894163] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c81f5e-9888-4914-ab90-42d06116db49 deletion is rescheduled due to dependency. [ 963.894163] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.993240] env[65943]: INFO networking_nsxv3.common.synchronization [req-7cd5b856-4637-4df1-8e02-ef3fc74088ce req-04f8b3cc-f597-47d3-b213-9689c03ba7e0 tempest-AttachInterfacesTestJSON-882476571 tempest-AttachInterfacesTestJSON-882476571-project-member] Enqueued Resource ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 with Priority: HIGHEST for action security_group_members [ 963.993240] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 with Priority: HIGHEST for action security_group_members [ 963.993240] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8a054b-6bee-465e-84da-d50dfdc27f64 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.993240] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.993240] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.994172] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.994462] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.994844] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.995022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.995396] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.995592] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.995866] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.264855] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5a629bb-fe88-498c-a120-35da2e141a08 in Status: SUCCESS [ 964.265091] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.265302] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.265619] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.265735] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.266025] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.266157] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.266368] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.266463] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.266605] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.363904] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-916 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.364210] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-916" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.364210] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-916" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.364454] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-916" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.364702] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.365102] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.365251] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.365459] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.365607] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.365821] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 964.366101] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 964.366302] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 964.366428] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 964.366554] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 964.366668] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 964.366811] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 964.394808] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 964.395056] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 964.395233] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 964.395457] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-916" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.395889] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-91a4155a-7232-47be-87d2-732e83df76af taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.396127] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-91a4155a-7232-47be-87d2-732e83df76af" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.396259] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-91a4155a-7232-47be-87d2-732e83df76af" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.396602] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-91a4155a-7232-47be-87d2-732e83df76af" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.396780] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91a4155a-7232-47be-87d2-732e83df76af',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.501301] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.501480] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.501554] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.501787] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.545641] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.545641] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.545873] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.545873] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.546550] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.546550] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.546550] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 is going to be updated. [ 964.581188] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.581188] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.581188] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.581188] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.581188] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.593224] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 in Status: IN_PROGRESS for 2s [ 964.643713] env[65943]: INFO networking_nsxv3.common.synchronization [req-794abf71-778e-4f05-82d2-02a990aa5bdb req-28ac78ad-2516-4264-8a7f-cab0ff06479b tempest-ServerGroupTestJSON-2061673576 tempest-ServerGroupTestJSON-2061673576-project-member] Enqueued Resource ID: ee79fa8c-44ea-481b-acf3-ba71ab1ad09a with Priority: HIGHEST for action security_group_members [ 964.644307] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee79fa8c-44ea-481b-acf3-ba71ab1ad09a with Priority: HIGHEST for action security_group_members [ 964.644642] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.644761] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.644808] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.645232] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.645397] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.645499] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.645562] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.645723] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.645811] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.645904] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee79fa8c-44ea-481b-acf3-ba71ab1ad09a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.769634] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.769806] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.769849] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.770089] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.770186] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.770430] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.770539] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.770604] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.770764] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.770851] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.770932] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5a629bb-fe88-498c-a120-35da2e141a08 is going to be updated. [ 964.800333] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.800529] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.800529] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.800760] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.800950] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.811129] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5a629bb-fe88-498c-a120-35da2e141a08 in Status: IN_PROGRESS for 2s [ 964.899979] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.900243] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.900403] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.900760] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.900961] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.901151] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port 91a4155a-7232-47be-87d2-732e83df76af not found, creating... [ 964.901418] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.901579] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.901696] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.901917] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.902096] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.902443] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.902624] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.902756] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.903227] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.903434] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.903764] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: 91a4155a-7232-47be-87d2-732e83df76af is going to be created. [ 964.941149] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.941379] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.941496] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.941798] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.942041] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.942283] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-91a4155a-7232-47be-87d2-732e83df76af" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.147592] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.147819] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.147926] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.148263] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.148365] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.148601] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.148721] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.148789] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.149030] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.149126] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.149229] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee79fa8c-44ea-481b-acf3-ba71ab1ad09a is going to be updated. [ 965.178708] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.178931] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.178931] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.179198] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.179347] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.189079] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee79fa8c-44ea-481b-acf3-ba71ab1ad09a in Status: IN_PROGRESS for 2s [ 965.666059] env[65943]: INFO networking_nsxv3.common.synchronization [req-7cd5b856-4637-4df1-8e02-ef3fc74088ce req-a98a3a96-2e29-437a-a49c-603886d7f583 service nova] Enqueued Resource ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 with Priority: HIGHEST for action security_group_rules [ 965.666059] env[65943]: INFO networking_nsxv3.common.synchronization [req-7cd5b856-4637-4df1-8e02-ef3fc74088ce req-a98a3a96-2e29-437a-a49c-603886d7f583 service nova] Enqueued Resource ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 with Priority: HIGHEST for action security_group_members [ 965.666059] env[65943]: INFO networking_nsxv3.common.synchronization [req-7cd5b856-4637-4df1-8e02-ef3fc74088ce req-a98a3a96-2e29-437a-a49c-603886d7f583 service nova] Enqueued Resource ID: 91a4155a-7232-47be-87d2-732e83df76af with Priority: HIGHEST for action port [ 965.666535] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 with Priority: HIGHEST for action security_group_rules [ 965.666535] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 with Priority: HIGHEST for action security_group_members [ 965.666623] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91a4155a-7232-47be-87d2-732e83df76af with Priority: HIGHEST for action port [ 965.667664] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c8a054b-6bee-465e-84da-d50dfdc27f64 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.667664] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.667664] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.667664] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.667664] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.669417] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8a054b-6bee-465e-84da-d50dfdc27f64 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.669523] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.669821] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-91a4155a-7232-47be-87d2-732e83df76af taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.669934] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91a4155a-7232-47be-87d2-732e83df76af" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.670012] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91a4155a-7232-47be-87d2-732e83df76af" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.670280] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91a4155a-7232-47be-87d2-732e83df76af" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.670280] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91a4155a-7232-47be-87d2-732e83df76af',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.170623] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8a054b-6bee-465e-84da-d50dfdc27f64 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.170623] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.173884] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 91a4155a-7232-47be-87d2-732e83df76af with status ACTIVE [ 966.174126] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.174341] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.174341] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.174555] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.174644] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.175073] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.175073] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.175073] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.175204] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.175241] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.175401] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.175561] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.175561] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.175705] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.175776] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.175860] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 91a4155a-7232-47be-87d2-732e83df76af is going to be updated. [ 966.202074] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.202322] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.202448] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.202758] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.202988] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.203314] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91a4155a-7232-47be-87d2-732e83df76af" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.603599] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 in Status: SUCCESS [ 966.603804] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 deletion is rescheduled due to dependency. [ 966.603947] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.604138] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.604373] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.604558] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.604684] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.604747] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.604892] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.604985] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.605090] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.823025] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5a629bb-fe88-498c-a120-35da2e141a08 in Status: SUCCESS [ 966.823025] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5a629bb-fe88-498c-a120-35da2e141a08 deletion is rescheduled due to dependency. [ 966.823589] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.107564] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.199813] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee79fa8c-44ea-481b-acf3-ba71ab1ad09a in Status: SUCCESS [ 967.200013] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee79fa8c-44ea-481b-acf3-ba71ab1ad09a deletion is rescheduled due to dependency. [ 967.200144] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.611251] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.114193] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.114597] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.114597] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.114918] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.115090] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.115255] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 is going to be updated. [ 968.166493] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.166623] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.166623] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.166881] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.166983] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.176758] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 in Status: IN_PROGRESS for 2s [ 970.190029] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 in Status: SUCCESS [ 970.190029] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.190491] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.190491] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.192575] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.192575] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.192575] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.192575] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.192575] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.192575] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.192575] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.667568] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 970.667678] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 970.696217] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8a054b-6bee-465e-84da-d50dfdc27f64 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.696217] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.696217] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.696217] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.696217] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.696716] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.696716] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.696716] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.696716] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.696716] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.696905] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8a054b-6bee-465e-84da-d50dfdc27f64 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.696905] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.696981] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.697064] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.697591] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.697591] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.697591] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.697591] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.697776] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.697776] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.697776] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.201494] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c8a054b-6bee-465e-84da-d50dfdc27f64: rpc.has_security_group_logging(os_id): False [ 971.228860] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.228860] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.228860] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.228860] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.228860] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.228860] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.229350] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.229350] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.229350] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.229350] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.229485] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.229485] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.229561] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.229681] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.229763] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.229947] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.230442] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.230561] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.230689] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.230766] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.230855] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 is going to be updated. [ 971.314358] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.314837] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.314837] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.314837] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.315051] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.329165] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 in Status: IN_PROGRESS for 2s [ 971.854205] env[65943]: INFO networking_nsxv3.common.synchronization [req-d10701f7-6ec3-4ac1-84ad-d77d374ef730 req-8e8ac829-572f-49d9-97ad-88fa0b48e189 tempest-ImagesTestJSON-196343566 tempest-ImagesTestJSON-196343566-project-member] Enqueued Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_members [ 971.854947] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_members [ 971.855353] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c81f5e-9888-4914-ab90-42d06116db49 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.855481] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.855543] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.855756] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.855927] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.856063] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.856160] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.856390] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.856523] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.856654] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.223289] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-40 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.223626] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-40" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.223714] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-40" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.223956] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-40" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.224382] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.224640] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.224640] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.224793] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.224914] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.225374] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 972.225664] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 972.225854] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 972.225988] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 972.226135] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 972.226247] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 972.226383] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 972.244621] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 972.244794] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 972.244930] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 972.245202] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-40" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.245452] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-c53a41a8-6156-4e50-85ab-fcdfa1f94985 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.245800] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-c53a41a8-6156-4e50-85ab-fcdfa1f94985" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.245800] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-c53a41a8-6156-4e50-85ab-fcdfa1f94985" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.246176] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-c53a41a8-6156-4e50-85ab-fcdfa1f94985" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.246346] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c53a41a8-6156-4e50-85ab-fcdfa1f94985',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.358854] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.359147] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.359265] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.359582] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.359726] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.360065] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.360229] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.360325] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.360582] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.360720] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.360864] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c81f5e-9888-4914-ab90-42d06116db49 is going to be updated. [ 972.391266] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.391455] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.391498] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.391708] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.391850] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.406017] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c81f5e-9888-4914-ab90-42d06116db49 in Status: IN_PROGRESS for 2s [ 972.749158] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.749483] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.749631] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.750207] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.750425] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.750629] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port c53a41a8-6156-4e50-85ab-fcdfa1f94985 not found, creating... [ 972.750997] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.751400] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.751606] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.752148] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.752254] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.752614] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.752924] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.753106] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.753565] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.753772] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.753935] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: c53a41a8-6156-4e50-85ab-fcdfa1f94985 is going to be created. [ 972.790233] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.790755] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.791283] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.791714] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.792155] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.792587] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-c53a41a8-6156-4e50-85ab-fcdfa1f94985" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.343869] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 in Status: SUCCESS [ 973.344237] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.555137] env[65943]: INFO networking_nsxv3.common.synchronization [req-d10701f7-6ec3-4ac1-84ad-d77d374ef730 req-c5d362a9-7e7b-44df-9552-cce5fce1ec2e service nova] Enqueued Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_rules [ 973.555377] env[65943]: INFO networking_nsxv3.common.synchronization [req-d10701f7-6ec3-4ac1-84ad-d77d374ef730 req-c5d362a9-7e7b-44df-9552-cce5fce1ec2e service nova] Enqueued Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_members [ 973.555541] env[65943]: INFO networking_nsxv3.common.synchronization [req-d10701f7-6ec3-4ac1-84ad-d77d374ef730 req-c5d362a9-7e7b-44df-9552-cce5fce1ec2e service nova] Enqueued Resource ID: c53a41a8-6156-4e50-85ab-fcdfa1f94985 with Priority: HIGHEST for action port [ 973.557918] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_rules [ 973.557918] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_members [ 973.557918] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c53a41a8-6156-4e50-85ab-fcdfa1f94985 with Priority: HIGHEST for action port [ 973.557918] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0c81f5e-9888-4914-ab90-42d06116db49 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.558149] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.558149] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.559032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.559032] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.561383] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c81f5e-9888-4914-ab90-42d06116db49 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.561971] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.562058] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-c53a41a8-6156-4e50-85ab-fcdfa1f94985 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.562702] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c53a41a8-6156-4e50-85ab-fcdfa1f94985" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.562702] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c53a41a8-6156-4e50-85ab-fcdfa1f94985" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.564452] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c53a41a8-6156-4e50-85ab-fcdfa1f94985" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.564580] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c53a41a8-6156-4e50-85ab-fcdfa1f94985',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.067071] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c81f5e-9888-4914-ab90-42d06116db49 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.067226] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.067472] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c53a41a8-6156-4e50-85ab-fcdfa1f94985 with status ACTIVE [ 974.067647] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.067756] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.067810] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.068101] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.068352] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.068352] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.068525] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.068525] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.069090] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.069229] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.069482] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.069538] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.069569] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.069719] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.070588] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.070732] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c53a41a8-6156-4e50-85ab-fcdfa1f94985 is going to be updated. [ 974.091319] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.091466] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.091554] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.091867] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.092021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.092185] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c53a41a8-6156-4e50-85ab-fcdfa1f94985" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.416872] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c81f5e-9888-4914-ab90-42d06116db49 in Status: SUCCESS [ 974.417383] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c81f5e-9888-4914-ab90-42d06116db49 deletion is rescheduled due to dependency. [ 974.417383] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.417383] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.417738] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.417738] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.417869] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.417915] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.418140] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.418140] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.418257] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.539284] env[65943]: INFO networking_nsxv3.common.synchronization [None req-34ad2559-4830-445e-b89c-f6c51f8ee2f1 tempest-AttachInterfacesTestJSON-882476571 tempest-AttachInterfacesTestJSON-882476571-project-member] Enqueued Resource ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 with Priority: HIGHEST for action security_group_members [ 974.539284] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 with Priority: HIGHEST for action security_group_members [ 974.539284] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8a054b-6bee-465e-84da-d50dfdc27f64 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.541266] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.541384] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.541616] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.541826] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.542088] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.542088] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.542223] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.542287] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.542563] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.920911] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.044694] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.423231] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.546534] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.925402] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.925578] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.925617] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.925902] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.925972] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.926099] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c81f5e-9888-4914-ab90-42d06116db49 is going to be updated. [ 975.953965] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.954222] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.954222] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.954427] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.954584] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.962691] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c81f5e-9888-4914-ab90-42d06116db49 in Status: IN_PROGRESS for 2s [ 976.049725] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.049725] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.049725] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.050028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.050028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.050110] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 is going to be updated. [ 976.082971] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.083804] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.083804] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.083804] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.083804] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.093188] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 in Status: IN_PROGRESS for 2s [ 976.628384] env[65943]: INFO networking_nsxv3.common.synchronization [None req-ae81aae2-bc48-4948-b4c2-b638862c7d2c None None] Enqueued Resource ID: bfbedb65-03ac-4856-a339-e7a806cace8c with Priority: HIGHEST for action port [ 976.628896] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfbedb65-03ac-4856-a339-e7a806cace8c with Priority: HIGHEST for action port [ 976.630259] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-bfbedb65-03ac-4856-a339-e7a806cace8c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.630259] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bfbedb65-03ac-4856-a339-e7a806cace8c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.630259] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bfbedb65-03ac-4856-a339-e7a806cace8c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.630522] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bfbedb65-03ac-4856-a339-e7a806cace8c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.630909] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfbedb65-03ac-4856-a339-e7a806cace8c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.843813] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-916 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.844046] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-916" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.844166] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-916" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.844499] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-916" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.844865] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.845040] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.845153] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.845373] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.845513] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.846439] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 976.846649] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 976.846815] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 976.847443] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 976.847505] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 976.847615] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 976.847751] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 976.867400] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 976.867498] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 976.867633] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 976.867810] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-916" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.868168] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-ce2159f5-e2fc-43f9-94ea-6906488ddacb taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.868343] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-ce2159f5-e2fc-43f9-94ea-6906488ddacb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.868460] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-ce2159f5-e2fc-43f9-94ea-6906488ddacb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.868775] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-ce2159f5-e2fc-43f9-94ea-6906488ddacb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.868913] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce2159f5-e2fc-43f9-94ea-6906488ddacb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.132942] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bfbedb65-03ac-4856-a339-e7a806cace8c [ 977.133235] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.134550] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.134550] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.134550] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.134550] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.134550] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bfbedb65-03ac-4856-a339-e7a806cace8c already deleted. [ 977.134550] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bfbedb65-03ac-4856-a339-e7a806cace8c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.374805] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.375043] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.375194] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.376293] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.376293] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.376293] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port ce2159f5-e2fc-43f9-94ea-6906488ddacb not found, creating... [ 977.376293] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.376293] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.376558] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.376592] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.379810] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.379810] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.379810] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.379810] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.379810] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.379810] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.379810] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: ce2159f5-e2fc-43f9-94ea-6906488ddacb is going to be created. [ 977.415643] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.415906] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.416114] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.416450] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.416779] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.417710] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-ce2159f5-e2fc-43f9-94ea-6906488ddacb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.978478] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c81f5e-9888-4914-ab90-42d06116db49 in Status: SUCCESS [ 977.978852] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.979453] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.979584] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.979781] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.979987] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.979987] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.980196] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.980271] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.980360] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.980451] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.107834] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 in Status: SUCCESS [ 978.108119] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.180464] env[65943]: INFO networking_nsxv3.common.synchronization [req-8abf24b8-5267-4c2b-b06a-c42b449183c0 req-00e60979-e654-42ab-9ad2-5f8fd9d44996 service nova] Enqueued Resource ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 with Priority: HIGHEST for action security_group_rules [ 978.180640] env[65943]: INFO networking_nsxv3.common.synchronization [req-8abf24b8-5267-4c2b-b06a-c42b449183c0 req-00e60979-e654-42ab-9ad2-5f8fd9d44996 service nova] Enqueued Resource ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 with Priority: HIGHEST for action security_group_members [ 978.180790] env[65943]: INFO networking_nsxv3.common.synchronization [req-8abf24b8-5267-4c2b-b06a-c42b449183c0 req-00e60979-e654-42ab-9ad2-5f8fd9d44996 service nova] Enqueued Resource ID: ce2159f5-e2fc-43f9-94ea-6906488ddacb with Priority: HIGHEST for action port [ 978.181346] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 with Priority: HIGHEST for action security_group_rules [ 978.181511] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 with Priority: HIGHEST for action security_group_members [ 978.181624] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce2159f5-e2fc-43f9-94ea-6906488ddacb with Priority: HIGHEST for action port [ 978.181931] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c8a054b-6bee-465e-84da-d50dfdc27f64 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.182032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.182096] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.182294] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.182377] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.183251] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8a054b-6bee-465e-84da-d50dfdc27f64 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.183355] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.183418] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.183583] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.183723] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.183810] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.183867] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.184978] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.184978] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.184978] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.184978] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce2159f5-e2fc-43f9-94ea-6906488ddacb taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.185910] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce2159f5-e2fc-43f9-94ea-6906488ddacb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.185910] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce2159f5-e2fc-43f9-94ea-6906488ddacb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.185910] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce2159f5-e2fc-43f9-94ea-6906488ddacb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.185910] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce2159f5-e2fc-43f9-94ea-6906488ddacb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.485095] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c81f5e-9888-4914-ab90-42d06116db49 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.485095] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.485095] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.485095] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.485095] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.485095] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.485095] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.485095] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.485095] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.485095] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.485095] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c81f5e-9888-4914-ab90-42d06116db49 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.485095] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.485095] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.485095] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.485095] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.485095] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.485646] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.485646] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.485963] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.486385] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.486720] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.686758] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.688150] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8a054b-6bee-465e-84da-d50dfdc27f64 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.688734] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.689543] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ce2159f5-e2fc-43f9-94ea-6906488ddacb with status ACTIVE [ 978.689730] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.689846] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.689904] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.690120] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.690211] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.690381] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.690475] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.690535] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.690681] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.690758] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.690936] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.691723] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.692601] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.692601] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.692601] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.692601] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ce2159f5-e2fc-43f9-94ea-6906488ddacb is going to be updated. [ 978.715400] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.716244] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.716433] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.716900] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.717218] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.717551] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce2159f5-e2fc-43f9-94ea-6906488ddacb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.895992] env[65943]: INFO networking_nsxv3.common.synchronization [None req-6d5b074a-a821-41db-805a-861202e0d9c6 None None] Enqueued Resource ID: e4602e07-56dd-48a1-9572-0986903b433d with Priority: HIGHEST for action port [ 978.896568] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4602e07-56dd-48a1-9572-0986903b433d with Priority: HIGHEST for action port [ 978.897205] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4602e07-56dd-48a1-9572-0986903b433d taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.897506] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4602e07-56dd-48a1-9572-0986903b433d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.897603] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4602e07-56dd-48a1-9572-0986903b433d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.897969] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4602e07-56dd-48a1-9572-0986903b433d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.898102] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4602e07-56dd-48a1-9572-0986903b433d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.940059] env[65943]: INFO networking_nsxv3.common.synchronization [req-a46da0af-456b-4352-bc09-9d1561e23795 req-e43d8115-a0de-4350-afdd-14673cae688f tempest-SecurityGroupRulesNegativeTestJSON-334476196 tempest-SecurityGroupRulesNegativeTestJSON-334476196-project-member] Enqueued Resource ID: 5cd7b98a-fb7c-4891-bab1-fd10812079f6 with Priority: HIGHEST for action security_group_rules [ 978.940572] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cd7b98a-fb7c-4891-bab1-fd10812079f6 with Priority: HIGHEST for action security_group_rules [ 978.941085] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5cd7b98a-fb7c-4891-bab1-fd10812079f6 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.941179] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5cd7b98a-fb7c-4891-bab1-fd10812079f6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.941245] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5cd7b98a-fb7c-4891-bab1-fd10812079f6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.941483] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5cd7b98a-fb7c-4891-bab1-fd10812079f6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.941563] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5cd7b98a-fb7c-4891-bab1-fd10812079f6',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.988816] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0c81f5e-9888-4914-ab90-42d06116db49: rpc.has_security_group_logging(os_id): False [ 979.011192] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.011373] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.011439] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.011649] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.011737] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.011949] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.012080] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.012143] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.012472] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.012573] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.012788] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.014261] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.014261] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.014261] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.014261] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.014261] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.014261] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.014261] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.014261] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.014569] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.014569] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0c81f5e-9888-4914-ab90-42d06116db49 is going to be updated. [ 979.081687] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.081959] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.081959] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.082181] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.082320] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.096709] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0c81f5e-9888-4914-ab90-42d06116db49 in Status: IN_PROGRESS for 2s [ 979.190108] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.400126] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e4602e07-56dd-48a1-9572-0986903b433d [ 979.400853] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.400853] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.400853] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.401526] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.401747] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.401871] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e4602e07-56dd-48a1-9572-0986903b433d already deleted. [ 979.401963] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4602e07-56dd-48a1-9572-0986903b433d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.464964] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.465129] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.465199] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.465410] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.465502] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.465600] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5cd7b98a-fb7c-4891-bab1-fd10812079f6 already deleted. [ 979.465684] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5cd7b98a-fb7c-4891-bab1-fd10812079f6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.692557] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.692801] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.692908] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.693252] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.693412] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.693586] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 is going to be updated. [ 979.764311] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.764503] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.764546] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.764805] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.764954] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.775855] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 in Status: IN_PROGRESS for 2s [ 980.043834] env[65943]: INFO networking_nsxv3.common.synchronization [req-949f610f-6701-495a-8b89-828b7a50c66c req-b57942b0-bdcd-4b34-95ff-06efdb4ad30a tempest-SecurityGroupRulesNegativeTestJSON-334476196 tempest-SecurityGroupRulesNegativeTestJSON-334476196-project-member] Enqueued Resource ID: 5cd7b98a-fb7c-4891-bab1-fd10812079f6 with Priority: HIGHEST for action security_group_rules [ 980.045643] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cd7b98a-fb7c-4891-bab1-fd10812079f6 with Priority: HIGHEST for action security_group_rules [ 980.045643] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5cd7b98a-fb7c-4891-bab1-fd10812079f6 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.045643] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5cd7b98a-fb7c-4891-bab1-fd10812079f6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.045643] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5cd7b98a-fb7c-4891-bab1-fd10812079f6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.045643] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5cd7b98a-fb7c-4891-bab1-fd10812079f6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.045643] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5cd7b98a-fb7c-4891-bab1-fd10812079f6',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.569275] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.569501] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.569585] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.569817] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.569914] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.570099] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5cd7b98a-fb7c-4891-bab1-fd10812079f6 already deleted. [ 980.570193] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5cd7b98a-fb7c-4891-bab1-fd10812079f6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.115691] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0c81f5e-9888-4914-ab90-42d06116db49 in Status: SUCCESS [ 981.115691] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.787822] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 in Status: SUCCESS [ 981.788454] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.788454] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.788597] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.788705] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.788840] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.788840] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.789024] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.789157] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.789230] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.789427] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.292140] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8a054b-6bee-465e-84da-d50dfdc27f64 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.292566] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.292566] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.292715] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.292947] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.293143] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.293326] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.293443] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.293567] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.294196] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.294196] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8a054b-6bee-465e-84da-d50dfdc27f64 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.294196] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.294196] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.294554] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.294554] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.294626] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.294693] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.294876] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.295553] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.295553] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.295553] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.306612] env[65943]: INFO networking_nsxv3.common.synchronization [req-d5694f17-c30d-4415-8ccf-27edff6cb1d0 req-9950864c-95e0-4694-a3c3-4357967198ce tempest-MigrationsAdminTest-607423609 tempest-MigrationsAdminTest-607423609-project-member] Enqueued Resource ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a with Priority: HIGHEST for action security_group_members [ 982.307101] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a with Priority: HIGHEST for action security_group_members [ 982.307588] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.307738] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.307825] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.308308] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.308308] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.308428] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.308582] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.308958] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.308958] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.309165] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.798260] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c8a054b-6bee-465e-84da-d50dfdc27f64: rpc.has_security_group_logging(os_id): False [ 982.814650] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.819290] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.819523] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.819523] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.819705] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.820611] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.821019] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.821205] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.821317] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.821598] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.821750] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.822089] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.822262] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.822388] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.822600] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.822726] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.823017] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.823177] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.823337] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.823852] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.823977] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.824270] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 is going to be updated. [ 982.905804] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.906139] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.906315] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.906612] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.906817] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.924993] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 in Status: IN_PROGRESS for 2s [ 983.318102] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.820833] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.821016] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.821094] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.821352] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.821449] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.821554] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a is going to be updated. [ 983.852240] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.852431] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.853298] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.853298] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.854573] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.864871] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a in Status: IN_PROGRESS for 2s [ 984.942280] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 in Status: SUCCESS [ 984.942634] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.714752] env[65943]: INFO networking_nsxv3.common.synchronization [req-4dfafce7-a681-4791-b821-377720792d50 req-6c33db86-6603-4e64-9a98-25e23ddb97c1 tempest-ServerActionsTestJSON-1587559204 tempest-ServerActionsTestJSON-1587559204-project-member] Enqueued Resource ID: 120a53f4-6f9e-423c-b6c7-c18e7f4310a8 with Priority: HIGHEST for action security_group_members [ 985.716311] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 120a53f4-6f9e-423c-b6c7-c18e7f4310a8 with Priority: HIGHEST for action security_group_members [ 985.716311] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-120a53f4-6f9e-423c-b6c7-c18e7f4310a8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.716311] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-120a53f4-6f9e-423c-b6c7-c18e7f4310a8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.716311] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-120a53f4-6f9e-423c-b6c7-c18e7f4310a8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.716952] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-120a53f4-6f9e-423c-b6c7-c18e7f4310a8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.716952] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.716952] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.716952] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.717180] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.717180] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.717243] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('120a53f4-6f9e-423c-b6c7-c18e7f4310a8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.875522] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a in Status: SUCCESS [ 985.875722] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.220081] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.220682] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.221779] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.222111] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.246382] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.246382] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.246382] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.246382] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.246382] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.246382] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.246382] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 120a53f4-6f9e-423c-b6c7-c18e7f4310a8 is going to be updated. [ 986.279152] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.279473] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.279473] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.279620] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.279771] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.292196] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 120a53f4-6f9e-423c-b6c7-c18e7f4310a8 in Status: IN_PROGRESS for 2s [ 988.089684] env[65943]: INFO networking_nsxv3.common.synchronization [None req-73fdb63f-35db-4c78-bc86-f2fd5a2625be None None] Enqueued Resource ID: cf5ca2e1-2249-465f-8ae8-eb2d6eb5fd58 with Priority: HIGHEST for action port [ 988.090396] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf5ca2e1-2249-465f-8ae8-eb2d6eb5fd58 with Priority: HIGHEST for action port [ 988.090637] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf5ca2e1-2249-465f-8ae8-eb2d6eb5fd58 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.090637] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf5ca2e1-2249-465f-8ae8-eb2d6eb5fd58" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.090802] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf5ca2e1-2249-465f-8ae8-eb2d6eb5fd58" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.090962] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf5ca2e1-2249-465f-8ae8-eb2d6eb5fd58" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.091042] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf5ca2e1-2249-465f-8ae8-eb2d6eb5fd58',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.306873] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 120a53f4-6f9e-423c-b6c7-c18e7f4310a8 in Status: SUCCESS [ 988.306873] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 120a53f4-6f9e-423c-b6c7-c18e7f4310a8 deletion is rescheduled due to dependency. [ 988.306873] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-120a53f4-6f9e-423c-b6c7-c18e7f4310a8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.597029] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cf5ca2e1-2249-465f-8ae8-eb2d6eb5fd58 [ 988.597029] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.597029] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.597029] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.597029] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.597029] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.597394] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cf5ca2e1-2249-465f-8ae8-eb2d6eb5fd58 already deleted. [ 988.597394] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf5ca2e1-2249-465f-8ae8-eb2d6eb5fd58" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.912261] env[65943]: INFO networking_nsxv3.common.synchronization [req-9e42e5d6-5c37-4baf-a278-4be53c079e24 req-94f10dcc-d4bf-4d11-81dc-08e5ec835cad tempest-DeleteServersTestJSON-1404918926 tempest-DeleteServersTestJSON-1404918926-project-member] Enqueued Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_members [ 988.912638] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_members [ 988.912947] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.914212] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.914298] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.914641] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.914682] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.914769] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.914830] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.915313] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.915405] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.915504] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.418694] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.418694] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.418694] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.419302] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.419302] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.419979] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.419979] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.419979] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.419979] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.419979] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.419979] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 is going to be updated. [ 989.454448] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.454670] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.454670] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.454941] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.455051] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.467219] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: IN_PROGRESS for 2s [ 989.676679] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-749 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.676895] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-749" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.677027] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-749" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.677307] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-749" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.677583] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.677789] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.677956] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.679266] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.679648] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.679934] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 989.680085] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 989.680202] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 989.680317] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 989.680669] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 989.680905] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 989.681077] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 989.714024] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 989.714024] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 989.714024] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 989.714024] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-749" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.714024] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-84a65b30-742f-4d12-a7c0-260b92a9ac9f taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.714024] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-84a65b30-742f-4d12-a7c0-260b92a9ac9f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.714024] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-84a65b30-742f-4d12-a7c0-260b92a9ac9f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.714024] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-84a65b30-742f-4d12-a7c0-260b92a9ac9f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.714024] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84a65b30-742f-4d12-a7c0-260b92a9ac9f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.216413] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.216916] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.217162] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.217511] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.217719] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.218105] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port 84a65b30-742f-4d12-a7c0-260b92a9ac9f not found, creating... [ 990.218518] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.218734] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.218857] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.219253] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.219527] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.219968] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.220154] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.220286] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.220660] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.220835] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.220835] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: 84a65b30-742f-4d12-a7c0-260b92a9ac9f is going to be created. [ 990.246138] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.246511] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.246725] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.247116] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.247462] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.249171] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-84a65b30-742f-4d12-a7c0-260b92a9ac9f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.898802] env[65943]: INFO networking_nsxv3.common.synchronization [None req-bab1b90e-c055-45e1-83b1-ef0a2befa10d None None] Enqueued Resource ID: 722a9699-2d6e-40bd-843c-6444346e0bfe with Priority: HIGHEST for action port [ 990.900472] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 722a9699-2d6e-40bd-843c-6444346e0bfe with Priority: HIGHEST for action port [ 990.900472] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-722a9699-2d6e-40bd-843c-6444346e0bfe taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.900738] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-722a9699-2d6e-40bd-843c-6444346e0bfe" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.901342] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-722a9699-2d6e-40bd-843c-6444346e0bfe" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.901342] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-722a9699-2d6e-40bd-843c-6444346e0bfe" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.901491] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('722a9699-2d6e-40bd-843c-6444346e0bfe',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.017845] env[65943]: INFO networking_nsxv3.common.synchronization [req-9e42e5d6-5c37-4baf-a278-4be53c079e24 req-74cd1689-2f2c-40d5-9f8c-4b9d310da18c service nova] Enqueued Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_rules [ 991.018175] env[65943]: INFO networking_nsxv3.common.synchronization [req-9e42e5d6-5c37-4baf-a278-4be53c079e24 req-74cd1689-2f2c-40d5-9f8c-4b9d310da18c service nova] Enqueued Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_members [ 991.018434] env[65943]: INFO networking_nsxv3.common.synchronization [req-9e42e5d6-5c37-4baf-a278-4be53c079e24 req-74cd1689-2f2c-40d5-9f8c-4b9d310da18c service nova] Enqueued Resource ID: 84a65b30-742f-4d12-a7c0-260b92a9ac9f with Priority: HIGHEST for action port [ 991.019207] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_rules [ 991.019428] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_members [ 991.020024] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84a65b30-742f-4d12-a7c0-260b92a9ac9f with Priority: HIGHEST for action port [ 991.020369] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.020587] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.020735] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.021048] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.021151] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.022666] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.022666] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.022952] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-84a65b30-742f-4d12-a7c0-260b92a9ac9f taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.023139] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84a65b30-742f-4d12-a7c0-260b92a9ac9f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.023514] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84a65b30-742f-4d12-a7c0-260b92a9ac9f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.023514] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84a65b30-742f-4d12-a7c0-260b92a9ac9f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.023622] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84a65b30-742f-4d12-a7c0-260b92a9ac9f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.404786] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 722a9699-2d6e-40bd-843c-6444346e0bfe [ 991.405644] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.405931] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.406436] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.406436] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.406436] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.406647] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:722a9699-2d6e-40bd-843c-6444346e0bfe already deleted. [ 991.406689] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-722a9699-2d6e-40bd-843c-6444346e0bfe" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.481377] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: SUCCESS [ 991.481377] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 deletion is rescheduled due to dependency. [ 991.481605] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.481781] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.484610] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.484610] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.484610] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.484610] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.484610] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.484610] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.484610] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.525567] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.525840] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.526034] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 84a65b30-742f-4d12-a7c0-260b92a9ac9f with status ACTIVE [ 991.526567] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.526567] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.526567] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.527045] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.527045] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.527045] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.527045] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.527288] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.527288] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.527377] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.527577] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.530556] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.530556] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.530556] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.530556] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.530556] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 84a65b30-742f-4d12-a7c0-260b92a9ac9f is going to be updated. [ 991.555471] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.555617] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.555684] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.555898] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.556053] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.556255] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84a65b30-742f-4d12-a7c0-260b92a9ac9f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.756440] env[65943]: INFO networking_nsxv3.common.synchronization [req-7776ddf3-db1f-4e95-8542-94310ef73d3e req-a8366772-2d15-4345-a5e7-8972b94dfad4 tempest-SecurityGroupRulesTestJSON-1992086616 tempest-SecurityGroupRulesTestJSON-1992086616-project-member] Enqueued Resource ID: e1929e0c-ac6e-40e1-9980-c06bf7b421f3 with Priority: HIGHEST for action security_group_rules [ 991.757067] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1929e0c-ac6e-40e1-9980-c06bf7b421f3 with Priority: HIGHEST for action security_group_rules [ 991.757870] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1929e0c-ac6e-40e1-9980-c06bf7b421f3 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.758009] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1929e0c-ac6e-40e1-9980-c06bf7b421f3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.758087] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1929e0c-ac6e-40e1-9980-c06bf7b421f3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.758853] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1929e0c-ac6e-40e1-9980-c06bf7b421f3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.758853] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1929e0c-ac6e-40e1-9980-c06bf7b421f3',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.986998] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.282115] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.282312] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.282420] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.282681] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.282803] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.282920] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1929e0c-ac6e-40e1-9980-c06bf7b421f3 already deleted. [ 992.283051] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1929e0c-ac6e-40e1-9980-c06bf7b421f3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.384009] env[65943]: INFO networking_nsxv3.common.synchronization [req-a7f9b87f-1da3-444c-a3d7-8b1f6d3052b2 req-9fb76fd9-6857-4b6a-ad75-b4db18243c61 tempest-AttachInterfacesTestJSON-882476571 tempest-AttachInterfacesTestJSON-882476571-project-member] Enqueued Resource ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 with Priority: HIGHEST for action security_group_members [ 992.384619] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 with Priority: HIGHEST for action security_group_members [ 992.384927] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8a054b-6bee-465e-84da-d50dfdc27f64 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.385540] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.385664] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.385895] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.386191] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.386300] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.386353] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.386517] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.386645] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.386701] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.491820] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.890164] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.994764] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.995094] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.995094] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.995235] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.995331] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.995437] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 is going to be updated. [ 993.025415] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.025597] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.025636] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.025826] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.025962] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.039139] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: IN_PROGRESS for 2s [ 993.395372] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.608037] env[65943]: INFO networking_nsxv3.common.synchronization [None req-b83316e7-8b43-4abf-8ca8-72d18a69ed74 tempest-AttachInterfacesTestJSON-882476571 tempest-AttachInterfacesTestJSON-882476571-project-member] Enqueued Resource ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 with Priority: HIGHEST for action security_group_members [ 993.608710] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 with Priority: HIGHEST for action security_group_members [ 993.609071] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8a054b-6bee-465e-84da-d50dfdc27f64 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.610262] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.899245] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.899405] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.899456] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.899698] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.899792] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.899894] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 is going to be updated. [ 993.933205] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.933401] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.933466] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.933650] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.933854] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.944475] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 in Status: IN_PROGRESS for 2s [ 993.956472] env[65943]: INFO networking_nsxv3.common.synchronization [req-f6aad81c-0e7b-479c-8f1a-3d13eaa282fd req-07c89462-c043-4a28-899f-2798558120bb tempest-SecurityGroupRulesTestJSON-1992086616 tempest-SecurityGroupRulesTestJSON-1992086616-project-member] Enqueued Resource ID: fca35118-42d1-4938-9b0e-9b3cf85a9a52 with Priority: HIGHEST for action security_group_rules [ 993.957645] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fca35118-42d1-4938-9b0e-9b3cf85a9a52 with Priority: HIGHEST for action security_group_rules [ 993.958373] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fca35118-42d1-4938-9b0e-9b3cf85a9a52 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.959028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fca35118-42d1-4938-9b0e-9b3cf85a9a52" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.959028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fca35118-42d1-4938-9b0e-9b3cf85a9a52" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.959235] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fca35118-42d1-4938-9b0e-9b3cf85a9a52" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.959235] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fca35118-42d1-4938-9b0e-9b3cf85a9a52',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.140463] env[65943]: INFO networking_nsxv3.common.synchronization [None req-79bb7ce5-8306-43ea-b9ef-4eb816eaa209 None None] Enqueued Resource ID: ccfb42ec-b75a-4485-bcac-2085bad228e4 with Priority: HIGHEST for action port [ 994.140463] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccfb42ec-b75a-4485-bcac-2085bad228e4 with Priority: HIGHEST for action port [ 994.140463] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-ccfb42ec-b75a-4485-bcac-2085bad228e4 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.142787] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ccfb42ec-b75a-4485-bcac-2085bad228e4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.146116] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ccfb42ec-b75a-4485-bcac-2085bad228e4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.146116] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ccfb42ec-b75a-4485-bcac-2085bad228e4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.146116] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccfb42ec-b75a-4485-bcac-2085bad228e4',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.487043] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.487043] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.487043] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.487391] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.487391] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.487391] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fca35118-42d1-4938-9b0e-9b3cf85a9a52 already deleted. [ 994.487500] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fca35118-42d1-4938-9b0e-9b3cf85a9a52" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.647059] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ccfb42ec-b75a-4485-bcac-2085bad228e4 [ 994.647059] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.647059] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.647059] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.647059] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.647059] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.647059] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ccfb42ec-b75a-4485-bcac-2085bad228e4 already deleted. [ 994.647059] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ccfb42ec-b75a-4485-bcac-2085bad228e4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.051502] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: SUCCESS [ 995.051759] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.052369] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.052369] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.052617] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.052798] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.052900] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.053139] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.053391] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.053391] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.053526] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.556509] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.557042] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.557042] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.557263] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.557774] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.557981] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.558161] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.558454] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.558624] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.558845] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.559095] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.559487] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.559487] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.559722] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.559937] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.560143] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.560329] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.560826] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.560826] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.560919] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.561216] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.831484] env[65943]: INFO networking_nsxv3.common.synchronization [None req-1b830c08-21b2-43fe-a947-c90a1488506c tempest-ServersTestManualDisk-467634811 tempest-ServersTestManualDisk-467634811-project-member] Enqueued Resource ID: 2b092468-bc6e-49b4-be83-babaf5ab0786 with Priority: HIGHEST for action security_group_rules [ 995.831484] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b092468-bc6e-49b4-be83-babaf5ab0786 with Priority: HIGHEST for action security_group_rules [ 995.833521] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b092468-bc6e-49b4-be83-babaf5ab0786 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.833657] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b092468-bc6e-49b4-be83-babaf5ab0786" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.833736] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b092468-bc6e-49b4-be83-babaf5ab0786" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.834054] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b092468-bc6e-49b4-be83-babaf5ab0786" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.835234] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b092468-bc6e-49b4-be83-babaf5ab0786',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.961682] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 in Status: SUCCESS [ 995.961682] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.961682] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.961682] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.961682] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.961682] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.961682] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.961682] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.962779] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.962779] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.007839] env[65943]: INFO networking_nsxv3.common.synchronization [None req-1852149c-4fd6-4a32-95e3-fab96b3240bd tempest-ServersTestManualDisk-467634811 tempest-ServersTestManualDisk-467634811-project-member] Enqueued Resource ID: 2b092468-bc6e-49b4-be83-babaf5ab0786 with Priority: HIGHEST for action security_group_rules [ 996.009131] env[65943]: INFO networking_nsxv3.common.synchronization [req-db960830-26ad-4de3-a0c3-5eb77e72089c req-d0e3204e-da23-46ba-8aa1-d1f779002c33 tempest-ImagesTestJSON-196343566 tempest-ImagesTestJSON-196343566-project-member] Enqueued Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_members [ 996.009681] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b092468-bc6e-49b4-be83-babaf5ab0786 with Priority: HIGHEST for action security_group_rules [ 996.009897] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGHEST for action security_group_members [ 996.010408] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b092468-bc6e-49b4-be83-babaf5ab0786 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.010408] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b092468-bc6e-49b4-be83-babaf5ab0786" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.010739] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c81f5e-9888-4914-ab90-42d06116db49 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.010950] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.011082] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.011354] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.011629] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.011787] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.011923] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.012119] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.012271] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.012419] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.066537] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15454ceb-9062-41fb-908b-b5ae144dbe65: rpc.has_security_group_logging(os_id): False [ 996.124533] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.124533] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.124744] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.124882] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.124996] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.125660] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.125766] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.125833] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.126010] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.126099] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.126314] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.126485] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.126485] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.126631] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.126681] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.126844] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.126938] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.126990] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.127155] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.127242] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.127787] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 is going to be updated. [ 996.166407] env[65943]: INFO networking_nsxv3.common.synchronization [req-b2e0b462-422c-4239-9dbb-bbdfa87578ae req-11583898-5420-42ca-bd8c-e1ef5613d1e2 tempest-SecurityGroupRulesTestJSON-1992086616 tempest-SecurityGroupRulesTestJSON-1992086616-project-member] Enqueued Resource ID: 2bf2f49e-899d-4e21-8698-e38b9c978f09 with Priority: HIGHEST for action security_group_rules [ 996.166952] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bf2f49e-899d-4e21-8698-e38b9c978f09 with Priority: HIGHEST for action security_group_rules [ 996.167429] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2bf2f49e-899d-4e21-8698-e38b9c978f09 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.167916] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2bf2f49e-899d-4e21-8698-e38b9c978f09" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.169093] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2bf2f49e-899d-4e21-8698-e38b9c978f09" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.169395] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2bf2f49e-899d-4e21-8698-e38b9c978f09" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.169512] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2bf2f49e-899d-4e21-8698-e38b9c978f09',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.196154] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.196343] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.196420] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.196663] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.196831] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.227019] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: IN_PROGRESS for 2s [ 996.373577] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.373577] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.373577] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.373877] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.373877] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.374347] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b092468-bc6e-49b4-be83-babaf5ab0786 already deleted. [ 996.374347] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b092468-bc6e-49b4-be83-babaf5ab0786" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.374517] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b092468-bc6e-49b4-be83-babaf5ab0786" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.374847] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b092468-bc6e-49b4-be83-babaf5ab0786" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.375276] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b092468-bc6e-49b4-be83-babaf5ab0786',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.463767] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.463970] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.464118] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.464323] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.464466] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.464654] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.464751] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.464826] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.465053] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.465053] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.465915] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 is going to be updated. [ 996.498657] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.498953] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.498953] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.499113] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.499279] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.513168] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 in Status: IN_PROGRESS for 2s [ 996.514913] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.515903] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.515903] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.515903] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.515903] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.516182] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.516256] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.516496] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.516579] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.516659] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.517113] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c81f5e-9888-4914-ab90-42d06116db49 is going to be updated. [ 996.556490] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.556781] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.557108] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.557258] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.557500] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.571094] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c81f5e-9888-4914-ab90-42d06116db49 in Status: IN_PROGRESS for 2s [ 996.693657] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.693789] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.693828] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.694904] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.694904] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.694904] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2bf2f49e-899d-4e21-8698-e38b9c978f09 already deleted. [ 996.694904] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2bf2f49e-899d-4e21-8698-e38b9c978f09" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.900378] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.900378] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.900378] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.901642] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.901642] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.901642] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b092468-bc6e-49b4-be83-babaf5ab0786 already deleted. [ 996.901642] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b092468-bc6e-49b4-be83-babaf5ab0786" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.956641] env[65943]: INFO networking_nsxv3.common.synchronization [None req-ea4af67f-e829-4147-967a-05fd4ac29ff9 None None] Enqueued Resource ID: b79e6be3-8ceb-4d73-9c0f-3e3ede58e913 with Priority: HIGHEST for action port [ 996.957293] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b79e6be3-8ceb-4d73-9c0f-3e3ede58e913 with Priority: HIGHEST for action port [ 996.957646] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-b79e6be3-8ceb-4d73-9c0f-3e3ede58e913 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.957857] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b79e6be3-8ceb-4d73-9c0f-3e3ede58e913" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.957983] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b79e6be3-8ceb-4d73-9c0f-3e3ede58e913" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.958505] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b79e6be3-8ceb-4d73-9c0f-3e3ede58e913" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.958778] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b79e6be3-8ceb-4d73-9c0f-3e3ede58e913',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.977392] env[65943]: INFO networking_nsxv3.common.synchronization [req-b1bd5387-4573-4020-889b-c375340a8c73 req-e2a27460-154a-4580-a5a5-863dd357cc80 tempest-AttachInterfacesTestJSON-882476571 tempest-AttachInterfacesTestJSON-882476571-project-member] Enqueued Resource ID: 22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b with Priority: HIGHEST for action security_group_members [ 996.978027] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b with Priority: HIGHEST for action security_group_members [ 996.978439] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.978561] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.978623] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.978860] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.979437] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.979615] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.979752] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.980011] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.980237] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.980481] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.461247] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b79e6be3-8ceb-4d73-9c0f-3e3ede58e913 [ 997.461496] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.461697] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.461804] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.462389] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.462389] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.462543] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b79e6be3-8ceb-4d73-9c0f-3e3ede58e913 already deleted. [ 997.463541] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b79e6be3-8ceb-4d73-9c0f-3e3ede58e913" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.486427] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.487356] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.487356] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.487356] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.516150] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.516699] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.517164] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.517244] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.517482] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.520753] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.520753] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b is going to be updated. [ 997.567238] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.567660] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.567660] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.567958] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.568282] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.592355] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b in Status: IN_PROGRESS for 2s [ 997.833892] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-737 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.834209] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-737" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.834715] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-737" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.834888] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-737" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.835307] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.835391] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.835512] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.835828] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.836088] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.836814] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 997.836814] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 997.836814] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 997.837280] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 997.837280] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 997.837280] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 997.837408] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 997.861670] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 997.861908] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 997.862132] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 997.862315] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-737" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.862687] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-cd260d43-f640-4b97-b41f-14617a24b1a9 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.862893] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-cd260d43-f640-4b97-b41f-14617a24b1a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.863107] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-cd260d43-f640-4b97-b41f-14617a24b1a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.863459] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-cd260d43-f640-4b97-b41f-14617a24b1a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.863582] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd260d43-f640-4b97-b41f-14617a24b1a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.900916] env[65943]: INFO networking_nsxv3.common.synchronization [req-d48e871f-bf45-4226-849d-6e347a0ebfd7 req-daea4031-ae8c-4ae2-89e6-2f70335a5300 tempest-MigrationsAdminTest-607423609 tempest-MigrationsAdminTest-607423609-project-member] Enqueued Resource ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a with Priority: HIGHEST for action security_group_members [ 997.901569] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a with Priority: HIGHEST for action security_group_members [ 997.902357] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.902357] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.902357] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.902524] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.902654] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.902766] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.902828] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.902994] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.903094] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.903191] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.240422] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: SUCCESS [ 998.240696] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.368802] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.369696] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.369995] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.370487] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.370723] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.371120] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.371367] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.371570] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.371908] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.372084] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.372470] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.372632] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.372765] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.373999] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.373999] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.374198] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: cd260d43-f640-4b97-b41f-14617a24b1a9 is going to be updated. [ 998.404629] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.405316] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.405316] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.405818] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.406158] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.406451] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-cd260d43-f640-4b97-b41f-14617a24b1a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.407511] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.407621] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.408249] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.408249] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.434503] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.435743] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.435743] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.435743] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.435743] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.435743] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.435743] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a is going to be updated. [ 998.503745] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.503984] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.504054] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.504264] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.504475] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.516153] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a in Status: IN_PROGRESS for 2s [ 998.529655] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 in Status: SUCCESS [ 998.529826] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 deletion is rescheduled due to dependency. [ 998.529945] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.583969] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c81f5e-9888-4914-ab90-42d06116db49 in Status: SUCCESS [ 998.584312] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c81f5e-9888-4914-ab90-42d06116db49 deletion is rescheduled due to dependency. [ 998.584448] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.123477] env[65943]: INFO networking_nsxv3.common.synchronization [req-cef2d068-1834-4782-a444-0eed87488ccc req-1b0bd241-740d-41ed-8356-e4827a221ddf service nova] Enqueued Resource ID: 55c4b60d-641f-4044-8228-251f73d38ecb with Priority: HIGHEST for action security_group_rules [ 999.123676] env[65943]: INFO networking_nsxv3.common.synchronization [req-cef2d068-1834-4782-a444-0eed87488ccc req-1b0bd241-740d-41ed-8356-e4827a221ddf service nova] Enqueued Resource ID: 55c4b60d-641f-4044-8228-251f73d38ecb with Priority: HIGHEST for action security_group_members [ 999.123816] env[65943]: INFO networking_nsxv3.common.synchronization [req-cef2d068-1834-4782-a444-0eed87488ccc req-1b0bd241-740d-41ed-8356-e4827a221ddf service nova] Enqueued Resource ID: cd260d43-f640-4b97-b41f-14617a24b1a9 with Priority: HIGHEST for action port [ 999.124368] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55c4b60d-641f-4044-8228-251f73d38ecb with Priority: HIGHEST for action security_group_rules [ 999.124509] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55c4b60d-641f-4044-8228-251f73d38ecb with Priority: HIGHEST for action security_group_members [ 999.124609] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd260d43-f640-4b97-b41f-14617a24b1a9 with Priority: HIGHEST for action port [ 999.124886] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55c4b60d-641f-4044-8228-251f73d38ecb taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.125303] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.125455] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.125709] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.125863] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55c4b60d-641f-4044-8228-251f73d38ecb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.127621] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-55c4b60d-641f-4044-8228-251f73d38ecb taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.127745] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.127837] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.128091] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.128569] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.128569] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.128569] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.128799] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.128852] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.129502] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55c4b60d-641f-4044-8228-251f73d38ecb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.129984] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd260d43-f640-4b97-b41f-14617a24b1a9 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.130139] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd260d43-f640-4b97-b41f-14617a24b1a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.130177] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd260d43-f640-4b97-b41f-14617a24b1a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.130479] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd260d43-f640-4b97-b41f-14617a24b1a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.130558] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd260d43-f640-4b97-b41f-14617a24b1a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.268637] env[65943]: INFO networking_nsxv3.common.synchronization [req-29ef2d23-0731-4060-bda5-48d35cd8de99 req-9fbfaf3d-e424-434e-9e9c-23fe1a3dcccd tempest-AttachVolumeShelveTestJSON-1945734723 tempest-AttachVolumeShelveTestJSON-1945734723-project-member] Enqueued Resource ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 with Priority: HIGHEST for action security_group_members [ 999.269304] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 with Priority: HIGHEST for action security_group_members [ 999.269623] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7544afbe-03f8-421e-b9ed-b038f61ffc17 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.269742] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.269801] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.270013] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.273427] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.273582] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.273651] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.273852] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.273944] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.274058] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7544afbe-03f8-421e-b9ed-b038f61ffc17',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.355080] env[65943]: INFO networking_nsxv3.common.synchronization [req-dd5bca10-e54d-44d0-a74d-d3abfa38a65b req-54fb5b59-158e-45dd-84d7-f3f60beb3c9f tempest-SecurityGroupRulesTestJSON-1992086616 tempest-SecurityGroupRulesTestJSON-1992086616-project-member] Enqueued Resource ID: bdc5dcd5-23f3-493f-86a8-a72a93d49972 with Priority: HIGHEST for action security_group_rules [ 999.355163] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdc5dcd5-23f3-493f-86a8-a72a93d49972 with Priority: HIGHEST for action security_group_rules [ 999.355459] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdc5dcd5-23f3-493f-86a8-a72a93d49972 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.355798] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdc5dcd5-23f3-493f-86a8-a72a93d49972" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.355798] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdc5dcd5-23f3-493f-86a8-a72a93d49972" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.355973] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdc5dcd5-23f3-493f-86a8-a72a93d49972" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.355973] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdc5dcd5-23f3-493f-86a8-a72a93d49972',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.603783] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b in Status: SUCCESS [ 999.604173] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b deletion is rescheduled due to dependency. [ 999.604173] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.632017] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55c4b60d-641f-4044-8228-251f73d38ecb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.633090] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-55c4b60d-641f-4044-8228-251f73d38ecb taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.633228] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.633503] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cd260d43-f640-4b97-b41f-14617a24b1a9 with status ACTIVE [ 999.633628] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.633735] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.636702] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.636955] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.637723] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.637723] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.637723] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.637723] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.637723] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.637723] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.638039] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.638039] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.638039] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.638158] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.638254] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.638345] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cd260d43-f640-4b97-b41f-14617a24b1a9 is going to be updated. [ 999.668669] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.668669] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.668669] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.668669] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.668669] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.668669] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd260d43-f640-4b97-b41f-14617a24b1a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.780727] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.780973] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.780973] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.781435] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.781435] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.781510] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.781585] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.781627] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.781789] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.781864] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.781951] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 is going to be updated. [ 999.820054] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.820211] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.820280] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.820481] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.820628] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.833511] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 in Status: IN_PROGRESS for 2s [ 999.885721] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.885721] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.885721] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.885721] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.885950] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.885950] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdc5dcd5-23f3-493f-86a8-a72a93d49972 already deleted. [ 999.885950] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdc5dcd5-23f3-493f-86a8-a72a93d49972" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.134691] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55c4b60d-641f-4044-8228-251f73d38ecb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.337478] env[65943]: INFO networking_nsxv3.common.synchronization [req-ca5cc8f1-38be-4567-a15d-b1cbf7507684 req-aca59ec2-90eb-4bce-b8f0-16f0d229c1b4 tempest-SecurityGroupRulesTestJSON-1992086616 tempest-SecurityGroupRulesTestJSON-1992086616-project-member] Enqueued Resource ID: fc9471bb-a478-48e8-9f77-be26331f9c60 with Priority: HIGHEST for action security_group_rules [ 1000.338124] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc9471bb-a478-48e8-9f77-be26331f9c60 with Priority: HIGHEST for action security_group_rules [ 1000.338551] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc9471bb-a478-48e8-9f77-be26331f9c60 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.338731] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc9471bb-a478-48e8-9f77-be26331f9c60" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.338797] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc9471bb-a478-48e8-9f77-be26331f9c60" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.339109] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc9471bb-a478-48e8-9f77-be26331f9c60" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.347048] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc9471bb-a478-48e8-9f77-be26331f9c60',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.527169] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a in Status: SUCCESS [ 1000.527169] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a deletion is rescheduled due to dependency. [ 1000.527169] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.637178] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.637178] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.637640] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.637640] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.637640] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.637763] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55c4b60d-641f-4044-8228-251f73d38ecb is going to be updated. [ 1000.668700] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.668853] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.668891] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.669128] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.669286] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.694353] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55c4b60d-641f-4044-8228-251f73d38ecb in Status: IN_PROGRESS for 2s [ 1000.812225] env[65943]: INFO networking_nsxv3.common.synchronization [req-2eacabbb-6bc4-4c07-a792-7652b0e2110a req-6117f392-bc87-4f1d-9ef6-763c95253133 tempest-SecurityGroupRulesTestJSON-1992086616 tempest-SecurityGroupRulesTestJSON-1992086616-project-member] Enqueued Resource ID: fc9471bb-a478-48e8-9f77-be26331f9c60 with Priority: HIGHEST for action security_group_rules [ 1000.812602] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc9471bb-a478-48e8-9f77-be26331f9c60 with Priority: HIGHEST for action security_group_rules [ 1000.812905] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc9471bb-a478-48e8-9f77-be26331f9c60 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.813039] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc9471bb-a478-48e8-9f77-be26331f9c60" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.859791] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.860012] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.860157] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.860364] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.860467] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.860625] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc9471bb-a478-48e8-9f77-be26331f9c60 already deleted. [ 1000.860732] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc9471bb-a478-48e8-9f77-be26331f9c60" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.860963] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc9471bb-a478-48e8-9f77-be26331f9c60" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.861200] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc9471bb-a478-48e8-9f77-be26331f9c60" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.861304] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc9471bb-a478-48e8-9f77-be26331f9c60',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.296073] env[65943]: INFO networking_nsxv3.common.synchronization [req-58d16dd7-3727-4047-ae37-d2c82eb4bdc3 req-17e06438-5a40-4d82-8d65-f0a47e6c55d2 tempest-SecurityGroupRulesTestJSON-1992086616 tempest-SecurityGroupRulesTestJSON-1992086616-project-member] Enqueued Resource ID: fc9471bb-a478-48e8-9f77-be26331f9c60 with Priority: HIGHEST for action security_group_rules [ 1001.297023] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc9471bb-a478-48e8-9f77-be26331f9c60 with Priority: HIGHEST for action security_group_rules [ 1001.297208] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc9471bb-a478-48e8-9f77-be26331f9c60 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.297338] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc9471bb-a478-48e8-9f77-be26331f9c60" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.383060] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.383343] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.383343] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.383626] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.383809] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.383888] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc9471bb-a478-48e8-9f77-be26331f9c60 already deleted. [ 1001.383936] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc9471bb-a478-48e8-9f77-be26331f9c60" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.384114] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc9471bb-a478-48e8-9f77-be26331f9c60" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.384315] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc9471bb-a478-48e8-9f77-be26331f9c60" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.384448] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc9471bb-a478-48e8-9f77-be26331f9c60',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.846961] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 in Status: SUCCESS [ 1001.847266] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 deletion is rescheduled due to dependency. [ 1001.847307] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.905655] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.905760] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.906018] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.906053] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.906138] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.906236] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc9471bb-a478-48e8-9f77-be26331f9c60 already deleted. [ 1001.906322] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc9471bb-a478-48e8-9f77-be26331f9c60" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.706880] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55c4b60d-641f-4044-8228-251f73d38ecb in Status: SUCCESS [ 1002.707184] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.707429] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.707705] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.707957] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.708092] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.708278] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.708668] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.708771] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.708865] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.708960] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55c4b60d-641f-4044-8228-251f73d38ecb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.211482] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-55c4b60d-641f-4044-8228-251f73d38ecb taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.211482] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.212948] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.212948] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.212948] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.212948] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.212948] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.212948] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.212948] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.212948] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.212948] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-55c4b60d-641f-4044-8228-251f73d38ecb taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.212948] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.212948] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.212948] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.212948] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.213692] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.213692] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.213692] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.213692] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.213692] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.213692] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55c4b60d-641f-4044-8228-251f73d38ecb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.717433] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55c4b60d-641f-4044-8228-251f73d38ecb: rpc.has_security_group_logging(os_id): False [ 1003.737757] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.737757] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.737880] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.738466] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.762286] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.763483] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.763483] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.763483] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.763483] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.763483] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.763483] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.763483] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.763483] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.763946] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.763946] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.763946] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.764084] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.764163] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.764357] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.764413] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.764485] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55c4b60d-641f-4044-8228-251f73d38ecb is going to be updated. [ 1003.853279] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.853428] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.853503] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.853703] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.853846] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.868749] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55c4b60d-641f-4044-8228-251f73d38ecb in Status: IN_PROGRESS for 2s [ 1005.889971] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55c4b60d-641f-4044-8228-251f73d38ecb in Status: SUCCESS [ 1005.890359] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.299662] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1006.299662] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1007.075233] env[65943]: INFO networking_nsxv3.common.synchronization [None req-da25f877-8471-4d4e-bab9-1c52b41aeecd tempest-AttachInterfacesTestJSON-882476571 tempest-AttachInterfacesTestJSON-882476571-project-member] Enqueued Resource ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c with Priority: HIGHEST for action security_group_rules [ 1007.075233] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c with Priority: HIGHEST for action security_group_rules [ 1007.075233] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-735ba0f8-8502-49b1-93a7-4ac595ca177c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.075233] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.075233] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.075233] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.075233] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('735ba0f8-8502-49b1-93a7-4ac595ca177c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.251281] env[65943]: INFO networking_nsxv3.common.synchronization [None req-00afd6e8-6be9-44e2-b9d8-1afe7547229d tempest-AttachInterfacesTestJSON-882476571 tempest-AttachInterfacesTestJSON-882476571-project-member] Enqueued Resource ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c with Priority: HIGHEST for action security_group_rules [ 1007.251636] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c with Priority: HIGHEST for action security_group_rules [ 1007.251872] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-735ba0f8-8502-49b1-93a7-4ac595ca177c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.251990] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.604830] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.606222] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.606222] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.606222] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.606222] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.606222] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c already deleted. [ 1007.606222] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.606769] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.606769] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.606909] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('735ba0f8-8502-49b1-93a7-4ac595ca177c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.622763] env[65943]: INFO networking_nsxv3.common.synchronization [None req-cc781426-08be-4ebd-9714-5d456d92662c None None] Enqueued Resource ID: a0c405db-6bee-41ff-b93f-2c609d922b49 with Priority: HIGHEST for action port [ 1007.623408] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0c405db-6bee-41ff-b93f-2c609d922b49 with Priority: HIGHEST for action port [ 1007.624736] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0c405db-6bee-41ff-b93f-2c609d922b49 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.624736] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0c405db-6bee-41ff-b93f-2c609d922b49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.624736] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0c405db-6bee-41ff-b93f-2c609d922b49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.625777] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0c405db-6bee-41ff-b93f-2c609d922b49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.625777] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0c405db-6bee-41ff-b93f-2c609d922b49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.127882] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a0c405db-6bee-41ff-b93f-2c609d922b49 [ 1008.128181] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.128559] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.128559] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.128666] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.129789] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.129789] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a0c405db-6bee-41ff-b93f-2c609d922b49 already deleted. [ 1008.129789] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0c405db-6bee-41ff-b93f-2c609d922b49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.132028] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.132166] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.132795] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.132795] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.132795] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.132795] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c already deleted. [ 1008.132795] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.298695] env[65943]: INFO networking_nsxv3.common.synchronization [None req-33bc01c3-568d-4ae5-8443-dc1d0bb3a549 None None] Enqueued Resource ID: 05326e8d-6158-4665-bdf2-691ba1cc2c14 with Priority: HIGHEST for action port [ 1010.298695] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05326e8d-6158-4665-bdf2-691ba1cc2c14 with Priority: HIGHEST for action port [ 1010.298695] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-05326e8d-6158-4665-bdf2-691ba1cc2c14 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.298695] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05326e8d-6158-4665-bdf2-691ba1cc2c14" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.299369] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05326e8d-6158-4665-bdf2-691ba1cc2c14" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.299369] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05326e8d-6158-4665-bdf2-691ba1cc2c14" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.299369] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05326e8d-6158-4665-bdf2-691ba1cc2c14',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.802432] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 05326e8d-6158-4665-bdf2-691ba1cc2c14 [ 1010.802803] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.802987] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.802987] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.803191] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.803309] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.803397] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:05326e8d-6158-4665-bdf2-691ba1cc2c14 already deleted. [ 1010.803498] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05326e8d-6158-4665-bdf2-691ba1cc2c14" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.386391] env[65943]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1012.386391] env[65943]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] NSXv3 Agent Agent loop - iteration:2 started [ 1012.749108] env[65943]: INFO networking_nsxv3.common.synchronization [req-b2d3ede9-2dfa-4238-96a4-1241a8687b5c req-303e98ce-7ec2-4c50-b300-6ba745767e92 tempest-ServersTestManualDisk-467634811 tempest-ServersTestManualDisk-467634811-project-member] Enqueued Resource ID: 2b092468-bc6e-49b4-be83-babaf5ab0786 with Priority: HIGHEST for action security_group_members [ 1012.749948] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b092468-bc6e-49b4-be83-babaf5ab0786 with Priority: HIGHEST for action security_group_members [ 1012.750320] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b092468-bc6e-49b4-be83-babaf5ab0786 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.750543] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b092468-bc6e-49b4-be83-babaf5ab0786" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.750636] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b092468-bc6e-49b4-be83-babaf5ab0786" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.750907] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b092468-bc6e-49b4-be83-babaf5ab0786" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.751147] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.751354] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.751354] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.751500] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.751594] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.751690] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b092468-bc6e-49b4-be83-babaf5ab0786',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.150839] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-240 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.151116] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-240" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.151261] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-240" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.151614] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-240" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.152144] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.152144] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.153249] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.153420] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.153608] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.153826] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1013.154056] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1013.154317] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1013.154482] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1013.154652] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1013.154759] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1013.154899] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1013.177351] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1013.177610] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1013.177787] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1013.178167] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-240" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.178408] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-31106c88-85f3-4937-8ddd-986604fc87a3 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.178731] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-31106c88-85f3-4937-8ddd-986604fc87a3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.178731] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-31106c88-85f3-4937-8ddd-986604fc87a3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.179021] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-31106c88-85f3-4937-8ddd-986604fc87a3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.179730] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31106c88-85f3-4937-8ddd-986604fc87a3',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.253433] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.253639] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.253698] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.253920] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.254024] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.254362] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.254473] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.254535] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.254702] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.254781] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.254884] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b092468-bc6e-49b4-be83-babaf5ab0786 already deleted. [ 1013.254961] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b092468-bc6e-49b4-be83-babaf5ab0786" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.683581] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.683987] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.683987] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.684298] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.684456] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.684629] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port 31106c88-85f3-4937-8ddd-986604fc87a3 not found, creating... [ 1013.684900] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.685097] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.685213] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.685454] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.685594] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.685920] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.687187] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.687505] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.687771] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.687961] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.688165] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: 31106c88-85f3-4937-8ddd-986604fc87a3 is going to be created. [ 1013.716177] env[65943]: INFO networking_nsxv3.common.synchronization [None req-2daaf7c7-5735-49f9-b5fc-7cb8cb40a196 None None] Enqueued Resource ID: 12fecfb9-7ecc-4a31-b436-0df88a81b772 with Priority: HIGHEST for action port [ 1013.717531] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12fecfb9-7ecc-4a31-b436-0df88a81b772 with Priority: HIGHEST for action port [ 1013.717668] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-12fecfb9-7ecc-4a31-b436-0df88a81b772 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.717844] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12fecfb9-7ecc-4a31-b436-0df88a81b772" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.717931] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12fecfb9-7ecc-4a31-b436-0df88a81b772" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.718281] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12fecfb9-7ecc-4a31-b436-0df88a81b772" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.718494] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12fecfb9-7ecc-4a31-b436-0df88a81b772',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.734648] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.734894] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.735019] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.735406] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.735694] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.735931] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-31106c88-85f3-4937-8ddd-986604fc87a3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.222681] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 12fecfb9-7ecc-4a31-b436-0df88a81b772 [ 1014.223022] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.223167] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.223167] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.223384] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.223473] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.223565] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:12fecfb9-7ecc-4a31-b436-0df88a81b772 already deleted. [ 1014.223645] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12fecfb9-7ecc-4a31-b436-0df88a81b772" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.490264] env[65943]: INFO networking_nsxv3.common.synchronization [req-b2d3ede9-2dfa-4238-96a4-1241a8687b5c req-7fae3b13-56de-408a-b189-d46432f06e25 service nova] Enqueued Resource ID: 2b092468-bc6e-49b4-be83-babaf5ab0786 with Priority: HIGHEST for action security_group_rules [ 1014.490497] env[65943]: INFO networking_nsxv3.common.synchronization [req-b2d3ede9-2dfa-4238-96a4-1241a8687b5c req-7fae3b13-56de-408a-b189-d46432f06e25 service nova] Enqueued Resource ID: 2b092468-bc6e-49b4-be83-babaf5ab0786 with Priority: HIGHEST for action security_group_members [ 1014.490616] env[65943]: INFO networking_nsxv3.common.synchronization [req-b2d3ede9-2dfa-4238-96a4-1241a8687b5c req-7fae3b13-56de-408a-b189-d46432f06e25 service nova] Enqueued Resource ID: 31106c88-85f3-4937-8ddd-986604fc87a3 with Priority: HIGHEST for action port [ 1014.491218] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b092468-bc6e-49b4-be83-babaf5ab0786 with Priority: HIGHEST for action security_group_rules [ 1014.491453] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b092468-bc6e-49b4-be83-babaf5ab0786 with Priority: HIGHEST for action security_group_members [ 1014.491453] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31106c88-85f3-4937-8ddd-986604fc87a3 with Priority: HIGHEST for action port [ 1014.491774] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b092468-bc6e-49b4-be83-babaf5ab0786 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.491949] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b092468-bc6e-49b4-be83-babaf5ab0786" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.492033] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b092468-bc6e-49b4-be83-babaf5ab0786" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.492181] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b092468-bc6e-49b4-be83-babaf5ab0786" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.492251] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b092468-bc6e-49b4-be83-babaf5ab0786',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.493168] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b092468-bc6e-49b4-be83-babaf5ab0786 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.493297] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b092468-bc6e-49b4-be83-babaf5ab0786" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.493580] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b092468-bc6e-49b4-be83-babaf5ab0786" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.493580] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b092468-bc6e-49b4-be83-babaf5ab0786" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.493689] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.493833] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.493833] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.494120] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.494201] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.494279] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b092468-bc6e-49b4-be83-babaf5ab0786',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.495108] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-31106c88-85f3-4937-8ddd-986604fc87a3 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.495261] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31106c88-85f3-4937-8ddd-986604fc87a3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.495330] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31106c88-85f3-4937-8ddd-986604fc87a3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.495499] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31106c88-85f3-4937-8ddd-986604fc87a3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.495499] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31106c88-85f3-4937-8ddd-986604fc87a3',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.999308] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b092468-bc6e-49b4-be83-babaf5ab0786 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.999308] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b092468-bc6e-49b4-be83-babaf5ab0786" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.999308] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b092468-bc6e-49b4-be83-babaf5ab0786',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.000514] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 31106c88-85f3-4937-8ddd-986604fc87a3 with status ACTIVE [ 1015.000514] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.000514] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.000514] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.000514] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.000514] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.001763] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.001763] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.001763] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.001763] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.001763] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.001763] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.002034] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.002034] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.002453] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.002453] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.002453] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 31106c88-85f3-4937-8ddd-986604fc87a3 is going to be updated. [ 1015.029803] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.030104] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.034168] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.034168] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.034168] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.034168] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31106c88-85f3-4937-8ddd-986604fc87a3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.504541] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b092468-bc6e-49b4-be83-babaf5ab0786',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.622479] env[65943]: INFO networking_nsxv3.common.synchronization [None req-e19295e3-c5a6-4c2e-a13a-ba4557b6c345 tempest-AttachVolumeShelveTestJSON-1945734723 tempest-AttachVolumeShelveTestJSON-1945734723-project-member] Enqueued Resource ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 with Priority: HIGHEST for action security_group_rules [ 1015.623083] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 with Priority: HIGHEST for action security_group_rules [ 1015.623451] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a97b14a2-a99a-4ce7-8cba-fd84de098977 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.623743] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.623743] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.624116] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.624216] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a97b14a2-a99a-4ce7-8cba-fd84de098977',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.769021] env[65943]: INFO networking_nsxv3.common.synchronization [None req-3f0cafe7-cd36-4cbe-a10a-ea318b4e4f5b tempest-AttachVolumeShelveTestJSON-1945734723 tempest-AttachVolumeShelveTestJSON-1945734723-project-member] Enqueued Resource ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 with Priority: HIGHEST for action security_group_rules [ 1015.769665] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 with Priority: HIGHEST for action security_group_rules [ 1015.770035] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a97b14a2-a99a-4ce7-8cba-fd84de098977 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.770423] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.007389] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.007713] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.007713] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.008182] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.008468] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.008631] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b092468-bc6e-49b4-be83-babaf5ab0786 is going to be created. [ 1016.033456] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.033553] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.033658] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.033887] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.034108] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.046491] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b092468-bc6e-49b4-be83-babaf5ab0786 in Status: UNINITIALIZED for 2s [ 1016.147580] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.149087] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.149087] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.149087] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.149087] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.149087] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 already deleted. [ 1016.149087] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.149087] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.149087] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.150315] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a97b14a2-a99a-4ce7-8cba-fd84de098977',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.239764] env[65943]: INFO networking_nsxv3.common.synchronization [None req-36428088-6ce7-4f0f-9416-1b665f4c88e0 None None] Enqueued Resource ID: 76b2390f-1257-4c94-a4f2-76b6e50ff820 with Priority: HIGHEST for action port [ 1016.240411] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76b2390f-1257-4c94-a4f2-76b6e50ff820 with Priority: HIGHEST for action port [ 1016.240740] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-76b2390f-1257-4c94-a4f2-76b6e50ff820 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.240911] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76b2390f-1257-4c94-a4f2-76b6e50ff820" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.240999] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76b2390f-1257-4c94-a4f2-76b6e50ff820" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.241676] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76b2390f-1257-4c94-a4f2-76b6e50ff820" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.242256] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76b2390f-1257-4c94-a4f2-76b6e50ff820',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.672771] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.673081] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.673081] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.673341] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.673459] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.673549] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 already deleted. [ 1016.674025] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.743896] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 76b2390f-1257-4c94-a4f2-76b6e50ff820 [ 1016.744203] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.744345] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.744421] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.744685] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.744777] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.744906] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:76b2390f-1257-4c94-a4f2-76b6e50ff820 already deleted. [ 1016.744989] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76b2390f-1257-4c94-a4f2-76b6e50ff820" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.057837] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b092468-bc6e-49b4-be83-babaf5ab0786 in Status: SUCCESS [ 1018.058195] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b092468-bc6e-49b4-be83-babaf5ab0786" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.058313] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b092468-bc6e-49b4-be83-babaf5ab0786" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.059187] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b092468-bc6e-49b4-be83-babaf5ab0786" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.059187] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.059407] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.059407] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.059570] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.059681] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.059802] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b092468-bc6e-49b4-be83-babaf5ab0786" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.059967] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2b092468-bc6e-49b4-be83-babaf5ab0786',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.562454] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2b092468-bc6e-49b4-be83-babaf5ab0786',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.064945] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2b092468-bc6e-49b4-be83-babaf5ab0786: rpc.has_security_group_logging(os_id): False [ 1019.084918] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.085100] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.085169] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.085603] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.085746] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.086050] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.086191] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.086287] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.086545] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.086635] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.086866] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b092468-bc6e-49b4-be83-babaf5ab0786 is going to be created. [ 1019.166648] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.166648] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.166648] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.166648] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.166648] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.179156] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b092468-bc6e-49b4-be83-babaf5ab0786 in Status: IN_PROGRESS for 2s [ 1021.194642] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b092468-bc6e-49b4-be83-babaf5ab0786 in Status: SUCCESS [ 1021.194978] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b092468-bc6e-49b4-be83-babaf5ab0786" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.241855] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1021.242027] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1026.225467] env[65943]: INFO networking_nsxv3.common.synchronization [req-65f8a910-ef74-437f-9198-703f3648ef16 req-3ff683af-de20-482a-9681-841686a13970 tempest-AttachInterfacesTestJSON-882476571 tempest-AttachInterfacesTestJSON-882476571-project-member] Enqueued Resource ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c with Priority: HIGHEST for action security_group_members [ 1026.226588] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c with Priority: HIGHEST for action security_group_members [ 1026.226917] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-735ba0f8-8502-49b1-93a7-4ac595ca177c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.227275] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.227352] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.227630] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.227841] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.227953] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.228051] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.228364] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.228463] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.228565] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('735ba0f8-8502-49b1-93a7-4ac595ca177c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.617034] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-916 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.617706] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-916" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.621018] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-916" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.621018] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-916" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.621018] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.621018] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.621018] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.621018] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.621018] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.621018] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1026.621018] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1026.621018] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1026.621018] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1026.621018] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1026.621018] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1026.621018] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1026.645024] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1026.645024] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1026.645024] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1026.645024] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-916" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.645024] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-dc957265-6f2f-41e8-818b-c97eeb49a3da taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.645024] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-dc957265-6f2f-41e8-818b-c97eeb49a3da" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.645024] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-dc957265-6f2f-41e8-818b-c97eeb49a3da" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.645761] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-dc957265-6f2f-41e8-818b-c97eeb49a3da" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.645761] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc957265-6f2f-41e8-818b-c97eeb49a3da',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.733213] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.733213] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.733213] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.733213] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.733213] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.733213] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.733213] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.733213] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.733213] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.733213] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.733213] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c already deleted. [ 1026.733213] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.148584] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.148881] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.149070] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.149385] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.149591] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.149762] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port dc957265-6f2f-41e8-818b-c97eeb49a3da not found, creating... [ 1027.150048] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.150208] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.150323] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.150552] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.150710] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.150977] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.151144] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.151260] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.151469] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.151626] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.151771] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: dc957265-6f2f-41e8-818b-c97eeb49a3da is going to be created. [ 1027.171944] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.172204] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.172282] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.172551] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.172781] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.173010] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-dc957265-6f2f-41e8-818b-c97eeb49a3da" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.908839] env[65943]: INFO networking_nsxv3.common.synchronization [req-65f8a910-ef74-437f-9198-703f3648ef16 req-7cc04cc6-3bb6-403e-80d9-72d315a305b2 service nova] Enqueued Resource ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c with Priority: HIGHEST for action security_group_rules [ 1027.908839] env[65943]: INFO networking_nsxv3.common.synchronization [req-65f8a910-ef74-437f-9198-703f3648ef16 req-7cc04cc6-3bb6-403e-80d9-72d315a305b2 service nova] Enqueued Resource ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c with Priority: HIGHEST for action security_group_members [ 1027.908839] env[65943]: INFO networking_nsxv3.common.synchronization [req-65f8a910-ef74-437f-9198-703f3648ef16 req-7cc04cc6-3bb6-403e-80d9-72d315a305b2 service nova] Enqueued Resource ID: dc957265-6f2f-41e8-818b-c97eeb49a3da with Priority: HIGHEST for action port [ 1027.909573] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c with Priority: HIGHEST for action security_group_rules [ 1027.909573] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c with Priority: HIGHEST for action security_group_members [ 1027.910058] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc957265-6f2f-41e8-818b-c97eeb49a3da with Priority: HIGHEST for action port [ 1027.910058] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-735ba0f8-8502-49b1-93a7-4ac595ca177c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.910156] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.910219] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.910473] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.910677] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('735ba0f8-8502-49b1-93a7-4ac595ca177c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.911480] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-735ba0f8-8502-49b1-93a7-4ac595ca177c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.911582] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.911635] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.911810] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.911951] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.912079] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.912141] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.912286] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.912392] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.912497] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('735ba0f8-8502-49b1-93a7-4ac595ca177c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.913798] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc957265-6f2f-41e8-818b-c97eeb49a3da taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.913908] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc957265-6f2f-41e8-818b-c97eeb49a3da" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.915196] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc957265-6f2f-41e8-818b-c97eeb49a3da" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.915196] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc957265-6f2f-41e8-818b-c97eeb49a3da" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.915196] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc957265-6f2f-41e8-818b-c97eeb49a3da',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.418032] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dc957265-6f2f-41e8-818b-c97eeb49a3da with status ACTIVE [ 1028.418032] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.418032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.418032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.418318] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.418318] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.418516] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.418616] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.418679] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.418950] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.419043] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.419213] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.419705] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.419705] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.419705] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.419705] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.419885] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dc957265-6f2f-41e8-818b-c97eeb49a3da is going to be updated. [ 1028.421720] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('735ba0f8-8502-49b1-93a7-4ac595ca177c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.422331] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-735ba0f8-8502-49b1-93a7-4ac595ca177c taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.422331] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.446712] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.446952] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.446952] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.447588] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.447588] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.447588] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc957265-6f2f-41e8-818b-c97eeb49a3da" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.608267] env[65943]: INFO networking_nsxv3.common.synchronization [req-ec514469-39cf-4651-a8c7-bf0284584c71 req-c9472165-de68-4326-ae61-5b595a174c3c tempest-ServerRescueNegativeTestJSON-734649129 tempest-ServerRescueNegativeTestJSON-734649129-project-member] Enqueued Resource ID: 7bf10448-5be8-4851-a7f0-5ce51163751a with Priority: HIGHEST for action security_group_members [ 1028.608970] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bf10448-5be8-4851-a7f0-5ce51163751a with Priority: HIGHEST for action security_group_members [ 1028.609463] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bf10448-5be8-4851-a7f0-5ce51163751a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.609582] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bf10448-5be8-4851-a7f0-5ce51163751a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.609582] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bf10448-5be8-4851-a7f0-5ce51163751a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.609788] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bf10448-5be8-4851-a7f0-5ce51163751a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.609965] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.610083] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.610225] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.610400] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.610510] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.610698] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bf10448-5be8-4851-a7f0-5ce51163751a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.833413] env[65943]: INFO networking_nsxv3.common.synchronization [req-beb1411d-d9fb-47ae-81d7-be8a9fe3a576 req-0a6b2c33-cdf6-4b57-a085-22c05625b229 tempest-ServersTestMultiNic-1452946458 tempest-ServersTestMultiNic-1452946458-project-member] Enqueued Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_members [ 1028.836557] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_members [ 1028.836557] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.836557] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.836557] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.836557] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.836557] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.836557] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.836557] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.836557] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.836557] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.836557] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.923259] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('735ba0f8-8502-49b1-93a7-4ac595ca177c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.113690] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.113822] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.113875] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.114123] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.136992] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.137283] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.137485] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.137546] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.137745] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.137832] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.137977] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bf10448-5be8-4851-a7f0-5ce51163751a is going to be updated. [ 1029.160818] env[65943]: INFO networking_nsxv3.common.synchronization [req-beb1411d-d9fb-47ae-81d7-be8a9fe3a576 req-6237021e-500b-4ad9-92d3-671080ef2ea2 tempest-ServersTestMultiNic-1452946458 tempest-ServersTestMultiNic-1452946458-project-member] Enqueued Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_members [ 1029.161816] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_members [ 1029.161816] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.161816] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.169180] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.169302] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.169458] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.169684] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.169831] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.182019] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bf10448-5be8-4851-a7f0-5ce51163751a in Status: IN_PROGRESS for 2s [ 1029.339083] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.339491] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.339584] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.339856] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.340078] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.340357] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.340469] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.340534] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.340783] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.340852] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.340883] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 already deleted. [ 1029.340964] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.341158] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.341313] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.341458] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.341549] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.341606] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.341762] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.341851] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.341952] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.426032] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.426386] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.426451] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.427109] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.427109] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.427109] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c is going to be created. [ 1029.456968] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.457379] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.457970] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.457970] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.457970] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.471994] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c in Status: UNINITIALIZED for 2s [ 1029.587070] env[65943]: INFO networking_nsxv3.common.synchronization [req-beb1411d-d9fb-47ae-81d7-be8a9fe3a576 req-137f0aea-8f01-464f-9ff3-0efc64f14f8e tempest-ServersTestMultiNic-1452946458 tempest-ServersTestMultiNic-1452946458-project-member] Enqueued Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_members [ 1029.587631] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_members [ 1029.587934] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.590993] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.850037] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.850037] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.850037] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.850037] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.850037] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.850037] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.850037] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.850037] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.850037] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.850037] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.850037] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 already deleted. [ 1029.850037] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.850037] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.850037] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.850037] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.850037] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.850037] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.850037] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.850888] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.852052] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.944017] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-537 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.944017] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-537" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.944017] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-537" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.950040] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-537" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.950040] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.950040] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.950040] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.950040] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.950040] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.950040] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1029.950040] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1029.950040] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1029.950040] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1029.950040] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1029.950040] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1029.950040] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1029.970736] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1029.971019] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1029.971239] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1029.971502] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-537" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.971898] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-daddd140-4386-419a-8276-931a7fff56b8 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.972497] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-daddd140-4386-419a-8276-931a7fff56b8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.972690] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-daddd140-4386-419a-8276-931a7fff56b8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.973515] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-daddd140-4386-419a-8276-931a7fff56b8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.973726] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('daddd140-4386-419a-8276-931a7fff56b8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.354349] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.354503] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.354563] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.354784] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.354872] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.355087] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.355182] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.355241] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.355389] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.355458] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.355544] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 already deleted. [ 1030.355622] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.477294] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.477562] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.477719] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.478066] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.478274] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.478501] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port daddd140-4386-419a-8276-931a7fff56b8 not found, creating... [ 1030.478817] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.479024] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.479183] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.479479] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.479665] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.480022] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.480226] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.480383] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.480647] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.480848] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.481035] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: daddd140-4386-419a-8276-931a7fff56b8 is going to be created. [ 1030.506026] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.506026] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.506026] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.506026] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.506026] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.506026] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-daddd140-4386-419a-8276-931a7fff56b8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.189668] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bf10448-5be8-4851-a7f0-5ce51163751a in Status: SUCCESS [ 1031.190088] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bf10448-5be8-4851-a7f0-5ce51163751a deletion is rescheduled due to dependency. [ 1031.190088] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bf10448-5be8-4851-a7f0-5ce51163751a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.261786] env[65943]: INFO networking_nsxv3.common.synchronization [req-beb1411d-d9fb-47ae-81d7-be8a9fe3a576 req-04809a38-28ea-4242-96ef-633907886be0 service nova] Enqueued Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_rules [ 1031.261995] env[65943]: INFO networking_nsxv3.common.synchronization [req-beb1411d-d9fb-47ae-81d7-be8a9fe3a576 req-04809a38-28ea-4242-96ef-633907886be0 service nova] Enqueued Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_members [ 1031.262176] env[65943]: INFO networking_nsxv3.common.synchronization [req-beb1411d-d9fb-47ae-81d7-be8a9fe3a576 req-04809a38-28ea-4242-96ef-633907886be0 service nova] Enqueued Resource ID: daddd140-4386-419a-8276-931a7fff56b8 with Priority: HIGHEST for action port [ 1031.262783] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_rules [ 1031.262939] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_members [ 1031.263078] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daddd140-4386-419a-8276-931a7fff56b8 with Priority: HIGHEST for action port [ 1031.263407] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-655fa9f8-1f2b-4cc8-b0fa-767189dc0172 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.263551] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.263623] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.263911] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.264027] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.265473] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.265596] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.265658] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.266670] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.266670] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.266670] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.266670] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.266670] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.266670] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.266922] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.267546] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-daddd140-4386-419a-8276-931a7fff56b8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.267664] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-daddd140-4386-419a-8276-931a7fff56b8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.267935] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-daddd140-4386-419a-8276-931a7fff56b8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.267935] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-daddd140-4386-419a-8276-931a7fff56b8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.267998] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('daddd140-4386-419a-8276-931a7fff56b8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.484040] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c in Status: SUCCESS [ 1031.484259] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.485376] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.485376] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.485376] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.485376] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.485649] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.486174] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.486174] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.486174] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.486174] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('735ba0f8-8502-49b1-93a7-4ac595ca177c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.769729] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.771865] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.772099] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.772424] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port daddd140-4386-419a-8276-931a7fff56b8 with status ACTIVE [ 1031.772616] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.772782] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.772782] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.772999] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.773144] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.773277] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.773369] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.773425] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.773582] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.773727] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.774029] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.774029] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.774223] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.774453] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.774453] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.774578] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: daddd140-4386-419a-8276-931a7fff56b8 is going to be updated. [ 1031.798168] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.798168] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.798168] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.798457] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.798526] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.800054] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-daddd140-4386-419a-8276-931a7fff56b8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.990899] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('735ba0f8-8502-49b1-93a7-4ac595ca177c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.043235] env[65943]: INFO networking_nsxv3.common.synchronization [req-137a6c86-e598-4f52-9f29-f0fb94a59d98 req-d5953213-8d8c-4562-9cd3-81f3356f6217 tempest-ServersNegativeTestJSON-1424653399 tempest-ServersNegativeTestJSON-1424653399-project-member] Enqueued Resource ID: 55c4b60d-641f-4044-8228-251f73d38ecb with Priority: HIGHEST for action security_group_members [ 1032.043748] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55c4b60d-641f-4044-8228-251f73d38ecb with Priority: HIGHEST for action security_group_members [ 1032.044108] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-55c4b60d-641f-4044-8228-251f73d38ecb taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.044273] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.044364] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.044659] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.044783] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.044887] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.044940] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.045114] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.045199] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.045356] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55c4b60d-641f-4044-8228-251f73d38ecb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.083339] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-274 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.083537] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-274" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.083661] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-274" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.083985] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-274" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.084251] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.084406] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.084519] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.084732] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.084875] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.085169] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1032.085305] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1032.085397] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1032.085505] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1032.085616] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1032.085721] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1032.085851] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1032.112151] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1032.112151] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1032.112151] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1032.112151] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-274" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.112151] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-e68d0063-c840-4af2-88e0-940d0d8fb7c6 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.112151] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-e68d0063-c840-4af2-88e0-940d0d8fb7c6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.112151] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-e68d0063-c840-4af2-88e0-940d0d8fb7c6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.112151] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-e68d0063-c840-4af2-88e0-940d0d8fb7c6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.112151] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e68d0063-c840-4af2-88e0-940d0d8fb7c6',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.273581] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.494892] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 735ba0f8-8502-49b1-93a7-4ac595ca177c: rpc.has_security_group_logging(os_id): False [ 1032.514430] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.514689] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.514801] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.515219] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.515371] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.515739] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.515904] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.516022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.516257] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.516387] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.516582] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c is going to be created. [ 1032.549916] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.549916] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.550218] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.550218] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.550340] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.550659] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.550805] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.551308] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.551308] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.551308] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.551480] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55c4b60d-641f-4044-8228-251f73d38ecb is going to be updated. [ 1032.619052] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.619299] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.619444] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.620010] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.620010] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.620335] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port e68d0063-c840-4af2-88e0-940d0d8fb7c6 not found, creating... [ 1032.620438] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.620881] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.620881] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.621058] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.621227] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.621524] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.621685] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.621812] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.622041] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.622198] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.622399] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: e68d0063-c840-4af2-88e0-940d0d8fb7c6 is going to be created. [ 1032.627877] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.628038] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.628096] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.628299] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.628669] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.644251] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.644492] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.644492] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.644634] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.644777] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.659580] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55c4b60d-641f-4044-8228-251f73d38ecb in Status: IN_PROGRESS for 2s [ 1032.668591] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c in Status: IN_PROGRESS for 2s [ 1032.715565] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.715789] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.716254] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.716389] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.716661] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.716904] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-e68d0063-c840-4af2-88e0-940d0d8fb7c6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.775950] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.775950] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.776099] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.776221] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.776332] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.776444] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 is going to be created. [ 1032.830208] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.830497] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.830497] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.830720] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.831036] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.846603] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 in Status: UNINITIALIZED for 2s [ 1033.357883] env[65943]: INFO networking_nsxv3.common.synchronization [req-beb1411d-d9fb-47ae-81d7-be8a9fe3a576 req-060c72b6-2527-4705-b6ff-969d599786f8 service nova] Enqueued Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_rules [ 1033.357883] env[65943]: INFO networking_nsxv3.common.synchronization [req-beb1411d-d9fb-47ae-81d7-be8a9fe3a576 req-060c72b6-2527-4705-b6ff-969d599786f8 service nova] Enqueued Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_members [ 1033.357883] env[65943]: INFO networking_nsxv3.common.synchronization [req-beb1411d-d9fb-47ae-81d7-be8a9fe3a576 req-060c72b6-2527-4705-b6ff-969d599786f8 service nova] Enqueued Resource ID: e68d0063-c840-4af2-88e0-940d0d8fb7c6 with Priority: HIGHEST for action port [ 1033.358406] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_rules [ 1033.358406] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_members [ 1033.358406] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e68d0063-c840-4af2-88e0-940d0d8fb7c6 with Priority: HIGHEST for action port [ 1033.359212] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-655fa9f8-1f2b-4cc8-b0fa-767189dc0172 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.359359] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.359693] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.359789] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.360077] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-e68d0063-c840-4af2-88e0-940d0d8fb7c6 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.360283] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e68d0063-c840-4af2-88e0-940d0d8fb7c6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.360376] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e68d0063-c840-4af2-88e0-940d0d8fb7c6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.360668] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e68d0063-c840-4af2-88e0-940d0d8fb7c6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.360820] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e68d0063-c840-4af2-88e0-940d0d8fb7c6',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.822206] env[65943]: INFO networking_nsxv3.common.synchronization [req-afb4cb8b-a913-4e2c-915e-e0cea2044533 req-0aff7403-aca5-4b15-a6ec-c60ee4a29a65 tempest-ImagesOneServerTestJSON-1305494692 tempest-ImagesOneServerTestJSON-1305494692-project-member] Enqueued Resource ID: ac6bded7-e3ef-4cd4-99c3-8bcb18296764 with Priority: HIGHEST for action security_group_members [ 1033.822727] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac6bded7-e3ef-4cd4-99c3-8bcb18296764 with Priority: HIGHEST for action security_group_members [ 1033.823131] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac6bded7-e3ef-4cd4-99c3-8bcb18296764 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.826811] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac6bded7-e3ef-4cd4-99c3-8bcb18296764" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.826931] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac6bded7-e3ef-4cd4-99c3-8bcb18296764" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.827331] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac6bded7-e3ef-4cd4-99c3-8bcb18296764" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.827435] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.827620] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.827620] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.827722] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.827776] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.827843] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac6bded7-e3ef-4cd4-99c3-8bcb18296764',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.864129] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e68d0063-c840-4af2-88e0-940d0d8fb7c6 with status ACTIVE [ 1033.864129] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.864129] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.864129] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.864129] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.864129] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.864129] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.864488] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.864488] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.864488] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.864488] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.864600] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.865098] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.865214] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.865342] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.865416] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.865503] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e68d0063-c840-4af2-88e0-940d0d8fb7c6 is going to be updated. [ 1033.888937] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.888937] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.888937] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.888937] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.888937] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.889262] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e68d0063-c840-4af2-88e0-940d0d8fb7c6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.261162] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-537 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.261451] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-537" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.261613] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-537" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.261938] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-537" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.262295] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.262521] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.262689] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.262983] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.263208] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.263470] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1034.263627] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1034.263753] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1034.263912] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1034.264479] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1034.264479] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1034.264479] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1034.277087] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-953 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.277312] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-953" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.277482] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-953" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.277837] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-953" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.278136] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.278314] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.278696] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.278791] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.278897] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.279126] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1034.279249] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1034.279361] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1034.279636] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1034.279844] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1034.279907] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1034.280037] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1034.284325] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1034.284497] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1034.284644] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1034.284811] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-537" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.285157] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-09c637a2-623f-4b3c-abbd-00c26d87c0b4 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.285332] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-09c637a2-623f-4b3c-abbd-00c26d87c0b4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.285451] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-09c637a2-623f-4b3c-abbd-00c26d87c0b4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.285781] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-09c637a2-623f-4b3c-abbd-00c26d87c0b4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.285937] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09c637a2-623f-4b3c-abbd-00c26d87c0b4',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.298729] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1034.298899] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1034.299122] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1034.299316] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-953" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.299716] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-aeebeef0-5771-49bd-a799-fba079c5a391 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.299900] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-aeebeef0-5771-49bd-a799-fba079c5a391" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.300119] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-aeebeef0-5771-49bd-a799-fba079c5a391" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.300568] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-aeebeef0-5771-49bd-a799-fba079c5a391" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.300642] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aeebeef0-5771-49bd-a799-fba079c5a391',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.330196] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.330360] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.330432] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.330644] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.330751] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.330971] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.331134] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.331211] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.331376] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.331454] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.331542] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac6bded7-e3ef-4cd4-99c3-8bcb18296764 already deleted. [ 1034.331624] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac6bded7-e3ef-4cd4-99c3-8bcb18296764" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.671400] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55c4b60d-641f-4044-8228-251f73d38ecb in Status: SUCCESS [ 1034.671785] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55c4b60d-641f-4044-8228-251f73d38ecb deletion is rescheduled due to dependency. [ 1034.671785] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.682639] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c in Status: SUCCESS [ 1034.682872] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.789149] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.789438] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.789438] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.789740] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.789897] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.790064] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port 09c637a2-623f-4b3c-abbd-00c26d87c0b4 not found, creating... [ 1034.790328] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.790482] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.790598] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.790835] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.790965] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.791258] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.791435] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.791565] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.791772] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.791904] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.792245] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: 09c637a2-623f-4b3c-abbd-00c26d87c0b4 is going to be created. [ 1034.803718] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.803922] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.804063] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.804301] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.804440] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.804585] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port aeebeef0-5771-49bd-a799-fba079c5a391 not found, creating... [ 1034.804851] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.804976] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.805105] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.805314] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.805467] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.805757] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.805911] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.806039] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.806245] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.806399] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.806538] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: aeebeef0-5771-49bd-a799-fba079c5a391 is going to be created. [ 1034.816625] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.816820] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.816941] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.817193] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.817413] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.817629] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-09c637a2-623f-4b3c-abbd-00c26d87c0b4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.827786] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.827975] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.828108] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.828361] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.828613] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.828837] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-aeebeef0-5771-49bd-a799-fba079c5a391" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.856222] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 in Status: SUCCESS [ 1034.856571] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.856755] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.856979] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.857190] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.857309] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.857373] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.857534] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.857615] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.857700] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.857794] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.858719] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.858882] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.859058] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.859157] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.859218] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.859354] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.859456] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.859564] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.361908] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.362986] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.363144] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.540253] env[65943]: INFO networking_nsxv3.common.synchronization [req-afb4cb8b-a913-4e2c-915e-e0cea2044533 req-23b606f4-309c-489b-ab97-49267360dd65 service nova] Enqueued Resource ID: ac6bded7-e3ef-4cd4-99c3-8bcb18296764 with Priority: HIGHEST for action security_group_rules [ 1035.540253] env[65943]: INFO networking_nsxv3.common.synchronization [req-afb4cb8b-a913-4e2c-915e-e0cea2044533 req-23b606f4-309c-489b-ab97-49267360dd65 service nova] Enqueued Resource ID: ac6bded7-e3ef-4cd4-99c3-8bcb18296764 with Priority: HIGHEST for action security_group_members [ 1035.540361] env[65943]: INFO networking_nsxv3.common.synchronization [req-afb4cb8b-a913-4e2c-915e-e0cea2044533 req-23b606f4-309c-489b-ab97-49267360dd65 service nova] Enqueued Resource ID: aeebeef0-5771-49bd-a799-fba079c5a391 with Priority: HIGHEST for action port [ 1035.540910] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac6bded7-e3ef-4cd4-99c3-8bcb18296764 with Priority: HIGHEST for action security_group_rules [ 1035.541070] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac6bded7-e3ef-4cd4-99c3-8bcb18296764 with Priority: HIGHEST for action security_group_members [ 1035.541170] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeebeef0-5771-49bd-a799-fba079c5a391 with Priority: HIGHEST for action port [ 1035.541476] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac6bded7-e3ef-4cd4-99c3-8bcb18296764 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.541603] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac6bded7-e3ef-4cd4-99c3-8bcb18296764" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.541704] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac6bded7-e3ef-4cd4-99c3-8bcb18296764" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.542046] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac6bded7-e3ef-4cd4-99c3-8bcb18296764" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.542141] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac6bded7-e3ef-4cd4-99c3-8bcb18296764',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.542984] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac6bded7-e3ef-4cd4-99c3-8bcb18296764 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.543374] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac6bded7-e3ef-4cd4-99c3-8bcb18296764" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.543374] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac6bded7-e3ef-4cd4-99c3-8bcb18296764" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.543374] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac6bded7-e3ef-4cd4-99c3-8bcb18296764" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.543506] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.543506] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.543587] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.544930] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.544930] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.544930] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac6bded7-e3ef-4cd4-99c3-8bcb18296764',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.544930] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-aeebeef0-5771-49bd-a799-fba079c5a391 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.545270] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aeebeef0-5771-49bd-a799-fba079c5a391" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.545270] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aeebeef0-5771-49bd-a799-fba079c5a391" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.545360] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aeebeef0-5771-49bd-a799-fba079c5a391" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.545404] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aeebeef0-5771-49bd-a799-fba079c5a391',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.548214] env[65943]: INFO networking_nsxv3.common.synchronization [req-beb1411d-d9fb-47ae-81d7-be8a9fe3a576 req-da039800-35d2-4215-8ef4-c675c9f3cc31 service nova] Enqueued Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_rules [ 1035.548214] env[65943]: INFO networking_nsxv3.common.synchronization [req-beb1411d-d9fb-47ae-81d7-be8a9fe3a576 req-da039800-35d2-4215-8ef4-c675c9f3cc31 service nova] Enqueued Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_members [ 1035.548214] env[65943]: INFO networking_nsxv3.common.synchronization [req-beb1411d-d9fb-47ae-81d7-be8a9fe3a576 req-da039800-35d2-4215-8ef4-c675c9f3cc31 service nova] Enqueued Resource ID: 09c637a2-623f-4b3c-abbd-00c26d87c0b4 with Priority: HIGHEST for action port [ 1035.551138] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_rules [ 1035.551293] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_members [ 1035.551396] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09c637a2-623f-4b3c-abbd-00c26d87c0b4 with Priority: HIGHEST for action port [ 1035.551662] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-655fa9f8-1f2b-4cc8-b0fa-767189dc0172 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.551761] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.551954] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.552111] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.552327] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-09c637a2-623f-4b3c-abbd-00c26d87c0b4 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.552464] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09c637a2-623f-4b3c-abbd-00c26d87c0b4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.552535] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09c637a2-623f-4b3c-abbd-00c26d87c0b4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.552814] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09c637a2-623f-4b3c-abbd-00c26d87c0b4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.552849] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09c637a2-623f-4b3c-abbd-00c26d87c0b4',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.852134] env[65943]: INFO networking_nsxv3.common.synchronization [req-79cda279-3135-4902-b45e-9cd87a9fe2a5 req-2d6d8ce3-6839-4039-8ffa-155afb58e22e tempest-ServerDiskConfigTestJSON-397438939 tempest-ServerDiskConfigTestJSON-397438939-project-member] Enqueued Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_members [ 1035.853273] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_members [ 1035.853501] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b127ff-135f-4cd2-9456-bc11d98737ce taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.853671] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.853825] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.854135] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.854363] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.854498] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.854605] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.854792] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.854939] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.855166] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.864225] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.047594] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac6bded7-e3ef-4cd4-99c3-8bcb18296764 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.047594] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac6bded7-e3ef-4cd4-99c3-8bcb18296764" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.052110] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac6bded7-e3ef-4cd4-99c3-8bcb18296764',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.052110] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aeebeef0-5771-49bd-a799-fba079c5a391 with status ACTIVE [ 1036.052110] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.052110] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.052110] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.052110] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.052110] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.052110] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.052110] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.052110] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.052110] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.052110] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.052110] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.052110] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.052110] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.052110] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.052689] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.052689] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aeebeef0-5771-49bd-a799-fba079c5a391 is going to be updated. [ 1036.058084] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 09c637a2-623f-4b3c-abbd-00c26d87c0b4 with status ACTIVE [ 1036.058084] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.058190] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.058226] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.058416] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.059166] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.059166] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.059166] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.059166] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.059436] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.059436] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.059575] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.059711] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.059791] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.060896] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.060896] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.060896] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 09c637a2-623f-4b3c-abbd-00c26d87c0b4 is going to be updated. [ 1036.084942] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.085105] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.085170] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.085382] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.085552] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.085693] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aeebeef0-5771-49bd-a799-fba079c5a391" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.086586] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.086696] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.086779] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.086924] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.087264] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.087264] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09c637a2-623f-4b3c-abbd-00c26d87c0b4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.257729] env[65943]: INFO networking_nsxv3.common.synchronization [req-a68790ac-cacc-4067-9df1-7ad8e4f79779 req-2c5dec5e-a048-4d1a-bbf2-f30e1070d891 tempest-AttachVolumeShelveTestJSON-1945734723 tempest-AttachVolumeShelveTestJSON-1945734723-project-member] Enqueued Resource ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 with Priority: HIGHEST for action security_group_members [ 1036.258570] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 with Priority: HIGHEST for action security_group_members [ 1036.258881] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-a97b14a2-a99a-4ce7-8cba-fd84de098977 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.258996] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.259078] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.259334] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.259491] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.259600] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.259656] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.259795] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.259873] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.259967] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a97b14a2-a99a-4ce7-8cba-fd84de098977',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.358612] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.358826] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.358885] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.359185] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.359288] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.359530] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.359672] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.359734] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.359903] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.359994] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.360128] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9b127ff-135f-4cd2-9456-bc11d98737ce is going to be updated. [ 1036.366940] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.367158] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.367204] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.367445] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.367615] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.367711] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 is going to be updated. [ 1036.394895] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.395149] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.395149] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.395322] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.395466] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.397474] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.397651] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.397780] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.398018] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.398143] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.408800] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 in Status: IN_PROGRESS for 2s [ 1036.409639] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b127ff-135f-4cd2-9456-bc11d98737ce in Status: IN_PROGRESS for 2s [ 1036.558432] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac6bded7-e3ef-4cd4-99c3-8bcb18296764',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.585387] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-695 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.585602] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-695" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.585727] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-695" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.585995] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-695" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.586269] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.586465] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.586588] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.586813] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.586955] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.587175] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1036.587286] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1036.587391] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1036.587496] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1036.587601] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1036.587702] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1036.587828] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1036.609236] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1036.609555] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1036.610179] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1036.610179] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-695" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.610324] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-e0f8089f-1f06-423f-b2ee-5f542752b690 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.610461] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-e0f8089f-1f06-423f-b2ee-5f542752b690" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.610499] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-e0f8089f-1f06-423f-b2ee-5f542752b690" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.610818] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-e0f8089f-1f06-423f-b2ee-5f542752b690" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.610956] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0f8089f-1f06-423f-b2ee-5f542752b690',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.761890] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.762090] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.762140] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.762352] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.762442] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.762653] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.762791] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.762859] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.763065] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.763192] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.763322] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 already deleted. [ 1036.763450] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.061819] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.062217] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.062217] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.062306] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.062380] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.062477] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac6bded7-e3ef-4cd4-99c3-8bcb18296764 is going to be created. [ 1037.088520] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.088771] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.088879] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.089219] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.089471] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.106474] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac6bded7-e3ef-4cd4-99c3-8bcb18296764 in Status: UNINITIALIZED for 2s [ 1037.114032] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.114343] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.114550] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.114942] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.115206] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.115446] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port e0f8089f-1f06-423f-b2ee-5f542752b690 not found, creating... [ 1037.115854] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.116334] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.116334] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.116748] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.116968] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.117427] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.117673] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.117864] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.118211] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.118460] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.118684] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: e0f8089f-1f06-423f-b2ee-5f542752b690 is going to be created. [ 1037.144427] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.144855] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.145082] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.145486] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.145846] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.146217] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-e0f8089f-1f06-423f-b2ee-5f542752b690" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.883225] env[65943]: INFO networking_nsxv3.common.synchronization [req-a68790ac-cacc-4067-9df1-7ad8e4f79779 req-add527ca-3a2d-4fff-8136-4bd6b8aeec1a service nova] Enqueued Resource ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 with Priority: HIGHEST for action security_group_rules [ 1037.883225] env[65943]: INFO networking_nsxv3.common.synchronization [req-a68790ac-cacc-4067-9df1-7ad8e4f79779 req-add527ca-3a2d-4fff-8136-4bd6b8aeec1a service nova] Enqueued Resource ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 with Priority: HIGHEST for action security_group_members [ 1037.883225] env[65943]: INFO networking_nsxv3.common.synchronization [req-a68790ac-cacc-4067-9df1-7ad8e4f79779 req-add527ca-3a2d-4fff-8136-4bd6b8aeec1a service nova] Enqueued Resource ID: e0f8089f-1f06-423f-b2ee-5f542752b690 with Priority: HIGHEST for action port [ 1037.883400] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 with Priority: HIGHEST for action security_group_rules [ 1037.883763] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 with Priority: HIGHEST for action security_group_members [ 1037.884125] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0f8089f-1f06-423f-b2ee-5f542752b690 with Priority: HIGHEST for action port [ 1037.884538] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a97b14a2-a99a-4ce7-8cba-fd84de098977 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.884912] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.884912] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.888022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.888022] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a97b14a2-a99a-4ce7-8cba-fd84de098977',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.888022] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-a97b14a2-a99a-4ce7-8cba-fd84de098977 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.888022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.888022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.888022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.888022] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.888022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.888022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.888022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.888022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.888022] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a97b14a2-a99a-4ce7-8cba-fd84de098977',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.889025] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0f8089f-1f06-423f-b2ee-5f542752b690 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.889291] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0f8089f-1f06-423f-b2ee-5f542752b690" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.889456] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0f8089f-1f06-423f-b2ee-5f542752b690" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.889719] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0f8089f-1f06-423f-b2ee-5f542752b690" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.889889] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0f8089f-1f06-423f-b2ee-5f542752b690',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.392603] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-a97b14a2-a99a-4ce7-8cba-fd84de098977 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.392603] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.393023] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a97b14a2-a99a-4ce7-8cba-fd84de098977',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.393841] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e0f8089f-1f06-423f-b2ee-5f542752b690 with status ACTIVE [ 1038.393984] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.394128] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.394197] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.394396] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.394490] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.394663] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.395492] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.395571] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.395938] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.396246] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.396326] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.396380] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.396441] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.396659] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.396659] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.396733] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e0f8089f-1f06-423f-b2ee-5f542752b690 is going to be updated. [ 1038.435157] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b127ff-135f-4cd2-9456-bc11d98737ce in Status: SUCCESS [ 1038.435351] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9b127ff-135f-4cd2-9456-bc11d98737ce deletion is rescheduled due to dependency. [ 1038.435463] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.437587] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 in Status: SUCCESS [ 1038.437894] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.438348] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.438606] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.438802] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.438923] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.438991] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.439177] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.439268] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.439356] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.440027] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.440027] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.440027] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.440027] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.440027] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.440426] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.440426] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.440426] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.440426] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.440585] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.440585] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.445035] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.445035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.445035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.445035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.445035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.445035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0f8089f-1f06-423f-b2ee-5f542752b690" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.445035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.445035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.445499] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.445499] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.445499] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.445499] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.445768] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.445768] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.899694] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a97b14a2-a99a-4ce7-8cba-fd84de098977',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.945520] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 655fa9f8-1f2b-4cc8-b0fa-767189dc0172: rpc.has_security_group_logging(os_id): False [ 1038.948247] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.965253] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.965423] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.965532] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.965824] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.965916] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.966164] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.966306] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.966381] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.966598] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.966672] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.966867] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.966973] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.967358] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.967529] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.967601] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.967853] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.967987] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.968056] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.968169] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.968247] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.968323] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 is going to be created. [ 1039.039265] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.039265] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.039265] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.039265] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.039265] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.052942] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 in Status: IN_PROGRESS for 2s [ 1039.129066] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac6bded7-e3ef-4cd4-99c3-8bcb18296764 in Status: SUCCESS [ 1039.129066] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac6bded7-e3ef-4cd4-99c3-8bcb18296764" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.129066] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac6bded7-e3ef-4cd4-99c3-8bcb18296764" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.129232] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac6bded7-e3ef-4cd4-99c3-8bcb18296764" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.129448] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.130670] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.130670] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.130670] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.130670] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.130670] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac6bded7-e3ef-4cd4-99c3-8bcb18296764" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.130670] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac6bded7-e3ef-4cd4-99c3-8bcb18296764',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.233271] env[65943]: INFO networking_nsxv3.common.synchronization [req-52ccfc0b-8ea6-48f1-9cc7-413d1525ced0 req-50820e8c-795c-4c56-8a5f-454ad392798f tempest-DeleteServersTestJSON-1404918926 tempest-DeleteServersTestJSON-1404918926-project-member] Enqueued Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_members [ 1039.233980] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_members [ 1039.234342] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.234478] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.235854] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.235854] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.235854] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.235854] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.235854] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.235854] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.235854] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.235854] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.405811] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.405811] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.405811] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.405811] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.405811] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.405811] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 is going to be created. [ 1039.432305] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.436168] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.436168] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.436168] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.436168] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.445290] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 in Status: UNINITIALIZED for 2s [ 1039.451322] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.632584] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac6bded7-e3ef-4cd4-99c3-8bcb18296764 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.632912] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac6bded7-e3ef-4cd4-99c3-8bcb18296764" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.633062] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac6bded7-e3ef-4cd4-99c3-8bcb18296764" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.633319] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac6bded7-e3ef-4cd4-99c3-8bcb18296764" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.633518] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.633655] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.633711] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.634287] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.634287] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.634287] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac6bded7-e3ef-4cd4-99c3-8bcb18296764" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.634287] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac6bded7-e3ef-4cd4-99c3-8bcb18296764 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.634287] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac6bded7-e3ef-4cd4-99c3-8bcb18296764" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.634538] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac6bded7-e3ef-4cd4-99c3-8bcb18296764" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.634538] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac6bded7-e3ef-4cd4-99c3-8bcb18296764" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.634741] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.634788] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.634824] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.634991] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.635107] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.635234] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac6bded7-e3ef-4cd4-99c3-8bcb18296764" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.635322] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac6bded7-e3ef-4cd4-99c3-8bcb18296764',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.738863] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.739061] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.739061] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.739232] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.739460] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.739577] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.739644] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.739730] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.739860] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.739937] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.740036] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 is going to be updated. [ 1039.779684] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.779875] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.779975] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.780244] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.780602] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.792524] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: IN_PROGRESS for 2s [ 1039.953203] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.953449] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.953449] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.953662] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.953759] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.953862] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 is going to be updated. [ 1039.998533] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.998786] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.998886] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.999460] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.999460] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.013310] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 in Status: IN_PROGRESS for 2s [ 1040.139494] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac6bded7-e3ef-4cd4-99c3-8bcb18296764: rpc.has_security_group_logging(os_id): False [ 1040.171902] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.172153] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.172153] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.172382] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.172495] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.172722] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.172847] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.172931] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.173162] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.173246] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.173475] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.173584] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.173643] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.173814] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.173901] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.174362] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.174486] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.174549] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.174700] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.174786] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.175490] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac6bded7-e3ef-4cd4-99c3-8bcb18296764 is going to be created. [ 1040.254116] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.254330] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.254330] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.254559] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.254915] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.269092] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac6bded7-e3ef-4cd4-99c3-8bcb18296764 in Status: IN_PROGRESS for 2s [ 1041.066205] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 in Status: SUCCESS [ 1041.066584] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.066633] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.067279] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.067279] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.464507] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 in Status: SUCCESS [ 1041.464741] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.464910] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.465160] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.465369] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.465506] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.465569] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.465698] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.465780] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.465863] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.465955] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a97b14a2-a99a-4ce7-8cba-fd84de098977',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.569556] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.569913] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.804931] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: SUCCESS [ 1041.805291] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 deletion is rescheduled due to dependency. [ 1041.805291] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.969987] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a97b14a2-a99a-4ce7-8cba-fd84de098977',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.027633] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 in Status: SUCCESS [ 1042.027633] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.027633] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.027633] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.027633] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.027633] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.027633] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.027633] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.027633] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.027633] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.027633] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.280451] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac6bded7-e3ef-4cd4-99c3-8bcb18296764 in Status: SUCCESS [ 1042.280757] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac6bded7-e3ef-4cd4-99c3-8bcb18296764" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.473605] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a97b14a2-a99a-4ce7-8cba-fd84de098977: rpc.has_security_group_logging(os_id): False [ 1042.493811] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.493811] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.494076] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.494182] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.494393] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.494669] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.494821] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.494896] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.495144] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.495291] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.495401] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 is going to be created. [ 1042.531477] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.531723] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.531798] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.532027] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.532234] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.532358] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.532444] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.532648] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.532765] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.532877] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.533083] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.533200] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.533286] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.533451] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.533739] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.533793] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.533836] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.533989] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.534103] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.534210] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.534331] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.561093] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.561306] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.561362] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.561630] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.561868] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.574286] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 in Status: IN_PROGRESS for 2s [ 1043.037419] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 655fa9f8-1f2b-4cc8-b0fa-767189dc0172: rpc.has_security_group_logging(os_id): False [ 1043.058263] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.058448] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.058554] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.058770] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.058877] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.059208] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.059544] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.059640] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.059744] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.059825] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.060038] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.060139] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.060201] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.060351] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.060425] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.060644] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.060772] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.061055] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.061055] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.061055] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.061203] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 is going to be updated. [ 1043.126472] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.126683] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.126810] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.127092] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.127730] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.142740] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 in Status: IN_PROGRESS for 2s [ 1044.235249] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1044.235534] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1044.587475] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 in Status: SUCCESS [ 1044.587728] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.155757] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 in Status: SUCCESS [ 1045.155988] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.156174] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.156398] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.156491] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.658786] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.659231] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.659231] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.659488] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.659680] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.659787] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.659912] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.660052] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.660115] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.660207] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.660300] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.163981] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.164160] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.164217] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.164486] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.165450] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.165450] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.165450] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.165450] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.165450] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.165450] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.165450] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.165450] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.165450] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.166258] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.166258] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.166258] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.166258] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.166258] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.166258] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.166258] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.166258] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.669493] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 655fa9f8-1f2b-4cc8-b0fa-767189dc0172: rpc.has_security_group_logging(os_id): False [ 1046.697224] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.697224] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.697224] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.697566] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.697566] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.697992] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.698217] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.698217] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.698380] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.698529] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.698776] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.698879] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.698943] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.699115] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.699190] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.699385] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.699528] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.699528] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.699672] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.699744] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.699838] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 is going to be updated. [ 1046.775722] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.775959] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.776085] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.776336] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.776493] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.793742] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 in Status: IN_PROGRESS for 2s [ 1047.626783] env[65943]: INFO networking_nsxv3.common.synchronization [req-3bf509fb-11f9-4e9b-9714-64fdafe169dd req-87a5a480-c7a1-4232-b3d3-f12277b3cf81 tempest-ServerActionsTestJSON-1587559204 tempest-ServerActionsTestJSON-1587559204-project-member] Enqueued Resource ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 with Priority: HIGHEST for action security_group_members [ 1047.628300] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 with Priority: HIGHEST for action security_group_members [ 1047.630022] env[65943]: INFO networking_nsxv3.common.synchronization [req-93f05677-cb42-4205-8bbe-9a94befc2855 req-b2a4dd54-3606-4138-a43a-404ff67f8f0c tempest-ServersTestMultiNic-1452946458 tempest-ServersTestMultiNic-1452946458-project-member] Enqueued Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_members [ 1047.630363] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bcdadce-edf2-43d0-a8d9-43033bb27e63 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.630542] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.630684] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.631016] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.631297] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.631472] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.631793] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.631954] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.632034] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.632234] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bcdadce-edf2-43d0-a8d9-43033bb27e63',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.633719] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_members [ 1047.634534] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.634534] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.634876] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.635140] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.635406] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.635572] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.635683] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.636337] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.636337] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.636337] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.891789] env[65943]: INFO networking_nsxv3.common.synchronization [req-93f05677-cb42-4205-8bbe-9a94befc2855 req-ba3caca7-1733-47f0-8f30-120b91bc9a97 tempest-ServersTestMultiNic-1452946458 tempest-ServersTestMultiNic-1452946458-project-member] Enqueued Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_members [ 1047.892449] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_members [ 1047.892865] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.893018] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.134633] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.134798] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.134879] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.135117] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.138855] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.163627] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.163627] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.163980] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.163980] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.164298] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.164409] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.164518] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 is going to be updated. [ 1048.200659] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.201495] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.201495] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.201495] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.201655] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.212520] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 in Status: IN_PROGRESS for 2s [ 1048.233310] env[65943]: INFO networking_nsxv3.common.synchronization [req-45709f75-2c3f-41b7-98d4-9efb5238ff17 req-14a3ebbf-7197-4d95-9f43-54bf47b75053 tempest-ServerActionsTestOtherA-92071881 tempest-ServerActionsTestOtherA-92071881-project-member] Enqueued Resource ID: 45bb0dcc-2197-4aae-a058-937524e3408a with Priority: HIGHEST for action security_group_members [ 1048.233310] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45bb0dcc-2197-4aae-a058-937524e3408a with Priority: HIGHEST for action security_group_members [ 1048.233310] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-45bb0dcc-2197-4aae-a058-937524e3408a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.233310] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45bb0dcc-2197-4aae-a058-937524e3408a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.233310] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45bb0dcc-2197-4aae-a058-937524e3408a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.233310] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45bb0dcc-2197-4aae-a058-937524e3408a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.233310] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.233310] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.233310] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.233310] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.233310] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.233310] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45bb0dcc-2197-4aae-a058-937524e3408a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.269638] env[65943]: INFO networking_nsxv3.common.synchronization [req-93f05677-cb42-4205-8bbe-9a94befc2855 req-8c0e18ab-5bb4-4024-b40d-becf5ae7afb8 tempest-ServersTestMultiNic-1452946458 tempest-ServersTestMultiNic-1452946458-project-member] Enqueued Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_members [ 1048.270455] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_members [ 1048.270850] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.270968] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.643582] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.735634] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.735792] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.736087] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.736331] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.758903] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.758990] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.759140] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.759188] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.759531] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.759672] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.759672] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45bb0dcc-2197-4aae-a058-937524e3408a is going to be updated. [ 1048.786989] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.787152] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.787198] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.787424] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.787579] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.800144] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45bb0dcc-2197-4aae-a058-937524e3408a in Status: IN_PROGRESS for 2s [ 1048.806339] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 in Status: SUCCESS [ 1048.806339] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.147933] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.148341] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.148341] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.148434] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.148468] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.148709] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 is going to be updated. [ 1049.177022] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.177208] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.177370] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.177636] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.177788] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.185976] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 in Status: IN_PROGRESS for 2s [ 1050.222442] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 in Status: SUCCESS [ 1050.222815] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 deletion is rescheduled due to dependency. [ 1050.222815] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.335569] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.335722] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.335784] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.336014] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.336167] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.812951] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45bb0dcc-2197-4aae-a058-937524e3408a in Status: SUCCESS [ 1050.813095] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45bb0dcc-2197-4aae-a058-937524e3408a deletion is rescheduled due to dependency. [ 1050.813276] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45bb0dcc-2197-4aae-a058-937524e3408a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.839319] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.200892] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 in Status: SUCCESS [ 1051.202110] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.202110] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.202110] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.202272] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.202272] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.202361] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.202696] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.202771] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.202877] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.342278] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.706170] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.706170] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.706170] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.706170] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.706170] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.706555] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.706555] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.706555] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.706712] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.706786] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.706900] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 is going to be updated. [ 1051.747508] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.747715] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.747715] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.747925] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.748088] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.759132] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 in Status: IN_PROGRESS for 2s [ 1051.848960] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1051.849153] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1052.176574] env[65943]: INFO networking_nsxv3.common.synchronization [req-481c793d-1dc7-49c2-a3c2-067281b63260 req-37930e12-283e-4e36-85eb-18e8b0afc1eb tempest-ServerRescueNegativeTestJSON-734649129 tempest-ServerRescueNegativeTestJSON-734649129-project-member] Enqueued Resource ID: 2d899613-c950-496a-aec6-9bbbbbf253b5 with Priority: HIGHEST for action security_group_members [ 1052.177161] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d899613-c950-496a-aec6-9bbbbbf253b5 with Priority: HIGHEST for action security_group_members [ 1052.177480] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d899613-c950-496a-aec6-9bbbbbf253b5 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.177605] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.177665] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.179410] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.179410] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.179410] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.179410] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.179410] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.179410] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.179410] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d899613-c950-496a-aec6-9bbbbbf253b5',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.632938] env[65943]: INFO networking_nsxv3.common.synchronization [req-6f97be59-88b5-427f-86e9-9415e968e97d req-b062c5d1-3a9f-4aee-854a-988f13da99d1 tempest-ServerDiskConfigTestJSON-397438939 tempest-ServerDiskConfigTestJSON-397438939-project-member] Enqueued Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_members [ 1052.634216] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_members [ 1052.634612] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b127ff-135f-4cd2-9456-bc11d98737ce taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.635208] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.635208] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.635208] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.635324] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.635525] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.635602] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.635692] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.635986] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.635986] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.668277] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.668427] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.668507] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.668753] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.686027] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1052.687165] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.688427] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1052.689963] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d899613-c950-496a-aec6-9bbbbbf253b5',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.756473] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.756890] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.757064] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.757364] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.768687] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.769822] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1052.770063] env[65943]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65943) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1052.770315] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1052.815175] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.815708] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.815990] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.816675] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.818650] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.820020] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1052.898376] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.898376] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.898376] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.898948] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.899515] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.900020] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1052.977444] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.977444] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.977444] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.977444] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.977945] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.978390] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:45. [ 1052.978590] env[65943]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'2a4b01a6-74af-4232-8012-76435e07acca', '2b7d77ea-cc30-4d0e-9a44-829eda93848d', 'a4f83bf4-ed34-4088-a422-46a4d9e5c7e1', '6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b', '735ba0f8-8502-49b1-93a7-4ac595ca177c', '22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b', '7544afbe-03f8-421e-b9ed-b038f61ffc17', '7c5e3a29-0bf9-4a6e-acfc-b7c273d94476', 'dcaf51d1-3d78-4731-8697-ec542f23f503', 'e02be8c7-70b1-4488-b079-b1ebf20a733c', '120a53f4-6f9e-423c-b6c7-c18e7f4310a8', '3d8fad12-41c9-413e-91de-8c1ff3cf914e', 'f5a629bb-fe88-498c-a120-35da2e141a08', '4b23ffb1-731f-42f8-bb4b-c106291be34d', '69913569-f584-45f7-91a4-ec8af89769a9', 'ee79fa8c-44ea-481b-acf3-ba71ab1ad09a', 'a97b14a2-a99a-4ce7-8cba-fd84de098977', '7bcdadce-edf2-43d0-a8d9-43033bb27e63', 'c00c3594-d682-43fb-9d53-d5100f161d24', '15454ceb-9062-41fb-908b-b5ae144dbe65', '7bf10448-5be8-4851-a7f0-5ce51163751a', 'c0c81f5e-9888-4914-ab90-42d06116db49', '55c4b60d-641f-4044-8228-251f73d38ecb', '68884628-4b38-403c-8fad-e29dfea783b0', 'ac6bded7-e3ef-4cd4-99c3-8bcb18296764', 'f293d027-3f3e-402a-bfe6-98af5d29163f', 'd97ff6f8-41cc-4974-82fe-bda7247ceb2b', '82c62f05-41a4-43fb-a74d-0baaee3b8043', '75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a', '655fa9f8-1f2b-4cc8-b0fa-767189dc0172', 'bad8ffbf-a375-4ee1-b522-c5e84af1b840', '8c8a054b-6bee-465e-84da-d50dfdc27f64', '2880c629-d8d0-45b5-b939-d99c78caab70', '3e3d8b17-4394-4674-b793-075706514abb', 'c9b127ff-135f-4cd2-9456-bc11d98737ce', '45bb0dcc-2197-4aae-a058-937524e3408a', '9a29bac0-8e63-4f6f-957d-9bd116500c7e', '2d899613-c950-496a-aec6-9bbbbbf253b5', '1059706e-9846-4d25-98c7-43c5aa686d19', 'b88e0956-a799-4c5e-8e71-323151811fd1', '89dec01a-fac4-47c6-9d76-7e922dba6ec4', '9539d191-87a5-4727-b693-a846f1e6f855', '2b092468-bc6e-49b4-be83-babaf5ab0786', 'dcee84a2-5f8e-4aff-856c-81b817d31434', 'cddfb2d8-8ac5-496b-aee4-ea09e6b59edf'} {{(pid=65943) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1052.978738] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1053.008433] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.008700] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.008792] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.009145] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.009275] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.009448] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1053.009546] env[65943]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65943) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1053.009645] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1053.052581] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-327 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.052753] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-327" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.052896] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-327" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.053217] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-327" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.053477] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.053931] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.054145] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.054426] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.054669] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.054996] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1053.055156] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1053.055328] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1053.055482] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1053.055641] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1053.055817] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1053.055997] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1053.075937] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1053.076096] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1053.076179] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1053.076369] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-327" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.076785] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-4af54653-e290-4dd8-8934-c7007a00a7f8 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.076928] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-4af54653-e290-4dd8-8934-c7007a00a7f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.077091] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-4af54653-e290-4dd8-8934-c7007a00a7f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.077374] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-4af54653-e290-4dd8-8934-c7007a00a7f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.079127] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4af54653-e290-4dd8-8934-c7007a00a7f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.095579] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.095579] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.095579] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.095579] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.100185] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.100534] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1053.100646] env[65943]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65943) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1053.100698] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1053.100739] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1053.100862] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/45 resources of Type:Security Group Rules [ 1053.100926] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2a4b01a6-74af-4232-8012-76435e07acca with Priority: HIGH for action security_group_rules [ 1053.100964] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2b7d77ea-cc30-4d0e-9a44-829eda93848d with Priority: HIGH for action security_group_rules [ 1053.101042] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 with Priority: HIGH for action security_group_rules [ 1053.101110] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b with Priority: HIGH for action security_group_rules [ 1053.101173] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c with Priority: HIGH for action security_group_rules [ 1053.101230] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b with Priority: HIGH for action security_group_rules [ 1053.101294] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 with Priority: HIGH for action security_group_rules [ 1053.101354] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7c5e3a29-0bf9-4a6e-acfc-b7c273d94476 with Priority: HIGH for action security_group_rules [ 1053.101414] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dcaf51d1-3d78-4731-8697-ec542f23f503 with Priority: HIGH for action security_group_rules [ 1053.101474] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e02be8c7-70b1-4488-b079-b1ebf20a733c with Priority: HIGH for action security_group_rules [ 1053.101535] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 120a53f4-6f9e-423c-b6c7-c18e7f4310a8 with Priority: HIGH for action security_group_rules [ 1053.101596] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e with Priority: HIGH for action security_group_rules [ 1053.101657] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f5a629bb-fe88-498c-a120-35da2e141a08 with Priority: HIGH for action security_group_rules [ 1053.101716] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d with Priority: HIGH for action security_group_rules [ 1053.101777] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGH for action security_group_rules [ 1053.101839] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ee79fa8c-44ea-481b-acf3-ba71ab1ad09a with Priority: HIGH for action security_group_rules [ 1053.101901] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 with Priority: HIGH for action security_group_rules [ 1053.101963] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 with Priority: HIGH for action security_group_rules [ 1053.105231] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c00c3594-d682-43fb-9d53-d5100f161d24 with Priority: HIGH for action security_group_rules [ 1053.105405] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGH for action security_group_rules [ 1053.105537] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.138758] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.138922] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.138978] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.139230] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.160084] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.160346] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.160461] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.160520] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.160720] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.160802] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.160922] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9b127ff-135f-4cd2-9456-bc11d98737ce is going to be updated. [ 1053.188452] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.188659] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.190213] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.190213] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.190213] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.192048] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d899613-c950-496a-aec6-9bbbbbf253b5',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.200075] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b127ff-135f-4cd2-9456-bc11d98737ce in Status: IN_PROGRESS for 2s [ 1053.582775] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.583069] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.583137] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.583429] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.583582] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.583736] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port 4af54653-e290-4dd8-8934-c7007a00a7f8 not found, creating... [ 1053.583995] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.584166] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.584293] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.584501] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.584632] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.584913] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.585088] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.585201] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.585406] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.585540] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.585677] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: 4af54653-e290-4dd8-8934-c7007a00a7f8 is going to be created. [ 1053.609046] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.609284] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.609423] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.609748] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.609991] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.610257] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-4af54653-e290-4dd8-8934-c7007a00a7f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.695727] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.696101] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.696101] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.696261] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.696261] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.696374] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d899613-c950-496a-aec6-9bbbbbf253b5 is going to be updated. [ 1053.754058] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.754266] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.754266] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.754500] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.754647] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.769413] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d899613-c950-496a-aec6-9bbbbbf253b5 in Status: IN_PROGRESS for 2s [ 1053.771932] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 in Status: SUCCESS [ 1053.772122] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 deletion is rescheduled due to dependency. [ 1053.772284] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.772412] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.772628] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.772825] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.772958] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.773046] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.773210] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.773343] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.773380] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.276182] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.276348] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.276417] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.276689] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.297319] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.297654] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.297775] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.297840] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.298068] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.298158] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.298247] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 is going to be updated. [ 1054.325025] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.325025] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.325025] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.325025] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.325025] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.327967] env[65943]: INFO networking_nsxv3.common.synchronization [req-6f97be59-88b5-427f-86e9-9415e968e97d req-185a28b2-b779-402f-99b0-6cb266133654 service nova] Enqueued Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_rules [ 1054.328231] env[65943]: INFO networking_nsxv3.common.synchronization [req-6f97be59-88b5-427f-86e9-9415e968e97d req-185a28b2-b779-402f-99b0-6cb266133654 service nova] Enqueued Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_members [ 1054.328434] env[65943]: INFO networking_nsxv3.common.synchronization [req-6f97be59-88b5-427f-86e9-9415e968e97d req-185a28b2-b779-402f-99b0-6cb266133654 service nova] Enqueued Resource ID: 4af54653-e290-4dd8-8934-c7007a00a7f8 with Priority: HIGHEST for action port [ 1054.329178] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_rules [ 1054.329373] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_members [ 1054.329538] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4af54653-e290-4dd8-8934-c7007a00a7f8 with Priority: HIGHEST for action port [ 1054.329654] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a4b01a6-74af-4232-8012-76435e07acca with Priority: HIGH for action security_group_rules [ 1054.329750] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 with Priority: HIGH for action security_group_rules [ 1054.329914] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 with Priority: HIGH for action security_group_rules [ 1054.329973] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69913569-f584-45f7-91a4-ec8af89769a9 with Priority: HIGH for action security_group_rules [ 1054.330018] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGH for action security_group_rules [ 1054.330104] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c00c3594-d682-43fb-9d53-d5100f161d24 with Priority: HIGH for action security_group_rules [ 1054.330759] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 with Priority: HIGH for action security_group_rules [ 1054.330759] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 with Priority: HIGH for action security_group_rules [ 1054.330759] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d with Priority: HIGH for action security_group_rules [ 1054.330759] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee79fa8c-44ea-481b-acf3-ba71ab1ad09a with Priority: HIGH for action security_group_rules [ 1054.330759] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5a629bb-fe88-498c-a120-35da2e141a08 with Priority: HIGH for action security_group_rules [ 1054.330759] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e with Priority: HIGH for action security_group_rules [ 1054.330759] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 120a53f4-6f9e-423c-b6c7-c18e7f4310a8 with Priority: HIGH for action security_group_rules [ 1054.331107] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e02be8c7-70b1-4488-b079-b1ebf20a733c with Priority: HIGH for action security_group_rules [ 1054.331107] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcaf51d1-3d78-4731-8697-ec542f23f503 with Priority: HIGH for action security_group_rules [ 1054.331107] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b with Priority: HIGH for action security_group_rules [ 1054.331107] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c5e3a29-0bf9-4a6e-acfc-b7c273d94476 with Priority: HIGH for action security_group_rules [ 1054.331263] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c with Priority: HIGH for action security_group_rules [ 1054.331263] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b7d77ea-cc30-4d0e-9a44-829eda93848d with Priority: HIGH for action security_group_rules [ 1054.331329] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b with Priority: HIGH for action security_group_rules [ 1054.332425] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9b127ff-135f-4cd2-9456-bc11d98737ce taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.332425] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.332581] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.332843] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.332843] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.334111] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b127ff-135f-4cd2-9456-bc11d98737ce taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.334247] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.334583] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-4af54653-e290-4dd8-8934-c7007a00a7f8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.334774] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4af54653-e290-4dd8-8934-c7007a00a7f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.334876] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4af54653-e290-4dd8-8934-c7007a00a7f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.335177] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4af54653-e290-4dd8-8934-c7007a00a7f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.335294] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4af54653-e290-4dd8-8934-c7007a00a7f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.336675] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a4b01a6-74af-4232-8012-76435e07acca taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.336817] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a4b01a6-74af-4232-8012-76435e07acca" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.336909] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a4b01a6-74af-4232-8012-76435e07acca" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.337547] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a4b01a6-74af-4232-8012-76435e07acca" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.337547] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a4b01a6-74af-4232-8012-76435e07acca',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.338353] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.338353] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.338353] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.338353] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.338353] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4f83bf4-ed34-4088-a422-46a4d9e5c7e1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.339432] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7544afbe-03f8-421e-b9ed-b038f61ffc17 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.339432] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.340198] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.340198] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.340326] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7544afbe-03f8-421e-b9ed-b038f61ffc17',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.340963] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69913569-f584-45f7-91a4-ec8af89769a9 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.341087] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.341153] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.341719] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.341719] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69913569-f584-45f7-91a4-ec8af89769a9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.342055] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.342158] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.342219] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.342365] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.342433] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.343495] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c00c3594-d682-43fb-9d53-d5100f161d24 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.343612] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.343768] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.343961] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.344073] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c00c3594-d682-43fb-9d53-d5100f161d24',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.345017] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.345127] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.345192] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.345342] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.345413] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7bcdadce-edf2-43d0-a8d9-43033bb27e63',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.346181] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a97b14a2-a99a-4ce7-8cba-fd84de098977 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.346608] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.346730] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.346956] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.346956] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a97b14a2-a99a-4ce7-8cba-fd84de098977',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.348048] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b23ffb1-731f-42f8-bb4b-c106291be34d taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.348158] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.348221] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.348387] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.348459] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b23ffb1-731f-42f8-bb4b-c106291be34d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.349537] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.349537] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.349671] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.349763] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.349838] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee79fa8c-44ea-481b-acf3-ba71ab1ad09a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.351040] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5a629bb-fe88-498c-a120-35da2e141a08 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.351715] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.351715] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.351715] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.351715] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5a629bb-fe88-498c-a120-35da2e141a08',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.352641] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d8fad12-41c9-413e-91de-8c1ff3cf914e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.352751] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.353787] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.353787] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.353787] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d8fad12-41c9-413e-91de-8c1ff3cf914e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.354334] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-120a53f4-6f9e-423c-b6c7-c18e7f4310a8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.354440] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-120a53f4-6f9e-423c-b6c7-c18e7f4310a8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.354504] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-120a53f4-6f9e-423c-b6c7-c18e7f4310a8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.355130] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-120a53f4-6f9e-423c-b6c7-c18e7f4310a8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.355130] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('120a53f4-6f9e-423c-b6c7-c18e7f4310a8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.355588] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e02be8c7-70b1-4488-b079-b1ebf20a733c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.355796] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.355928] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.355978] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.356064] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e02be8c7-70b1-4488-b079-b1ebf20a733c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.357412] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dcaf51d1-3d78-4731-8697-ec542f23f503 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.357539] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.357615] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.358158] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.358239] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dcaf51d1-3d78-4731-8697-ec542f23f503',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.359562] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.359696] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.359768] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.359953] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.360059] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.362422] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.362526] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.362640] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.362820] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.362894] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c5e3a29-0bf9-4a6e-acfc-b7c273d94476',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.363548] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-735ba0f8-8502-49b1-93a7-4ac595ca177c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.363660] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.363719] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.363866] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.363937] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('735ba0f8-8502-49b1-93a7-4ac595ca177c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.365720] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b7d77ea-cc30-4d0e-9a44-829eda93848d taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.365847] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b7d77ea-cc30-4d0e-9a44-829eda93848d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.365903] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b7d77ea-cc30-4d0e-9a44-829eda93848d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.366212] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b7d77ea-cc30-4d0e-9a44-829eda93848d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.366212] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b7d77ea-cc30-4d0e-9a44-829eda93848d',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.366855] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.366957] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.367160] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.367680] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.367680] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.369884] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 in Status: IN_PROGRESS for 2s [ 1054.372989] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b127ff-135f-4cd2-9456-bc11d98737ce taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.373153] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.392770] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.392908] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.392980] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.393204] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.412555] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.412667] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a4b01a6-74af-4232-8012-76435e07acca is going to be deleted. [ 1054.470042] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.470042] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.470042] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.470042] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.470042] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.470042] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a4b01a6-74af-4232-8012-76435e07acca" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.848864] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-a97b14a2-a99a-4ce7-8cba-fd84de098977 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.849269] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.849269] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.849443] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.849643] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.849743] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.849806] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.849965] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.850072] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.850185] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.850261] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a97b14a2-a99a-4ce7-8cba-fd84de098977',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.876508] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4af54653-e290-4dd8-8934-c7007a00a7f8 with status ACTIVE [ 1054.876721] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.876851] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.876917] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.877146] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.877274] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.877478] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.877589] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.877651] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.877807] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.877886] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.878085] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.878182] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.878264] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.878413] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.878665] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.878708] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4af54653-e290-4dd8-8934-c7007a00a7f8 is going to be updated. [ 1054.883460] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.883609] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.883728] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.884030] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.887169] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.887308] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.888838] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-735ba0f8-8502-49b1-93a7-4ac595ca177c taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.888993] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.889121] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.889305] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.889420] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.889511] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.889595] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.889763] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.889892] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.889995] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.890084] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('735ba0f8-8502-49b1-93a7-4ac595ca177c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.896066] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.896066] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.896303] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.896362] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.897085] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.897085] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.897085] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.897085] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.897085] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.897085] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.897539] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.944802] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.944802] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.947287] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.947287] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.947973] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.947973] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.948720] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.948839] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.949485] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.949577] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.950317] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.950429] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.951098] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.951215] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.951989] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.952118] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.952772] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.952946] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b23ffb1-731f-42f8-bb4b-c106291be34d is going to be deleted. [ 1054.953754] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.954019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.086596] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.086596] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.095534] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.095810] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.105375] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.105375] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.105571] env[65943]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1055.105981] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.106133] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5a629bb-fe88-498c-a120-35da2e141a08 is going to be deleted. [ 1055.107047] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.107974] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.109646] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.109813] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.118586] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.118845] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.119586] env[65943]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1055.120070] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.120194] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.120279] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.120497] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.120635] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.120795] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4af54653-e290-4dd8-8934-c7007a00a7f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.123298] env[65943]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1055.123789] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.123933] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.129923] env[65943]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1055.130451] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.130578] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b is going to be deleted. [ 1055.131567] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.131780] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.161646] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.161839] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e02be8c7-70b1-4488-b079-b1ebf20a733c is going to be deleted. [ 1055.162938] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.163204] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.180399] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.180633] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.200124] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.200328] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.203220] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.203367] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69913569-f584-45f7-91a4-ec8af89769a9 is going to be deleted. [ 1055.204277] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.204501] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.245239] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b127ff-135f-4cd2-9456-bc11d98737ce in Status: SUCCESS [ 1055.245239] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9b127ff-135f-4cd2-9456-bc11d98737ce deletion is rescheduled due to dependency. [ 1055.245383] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.245539] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.245786] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.246597] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.246597] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.246597] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.246597] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.246597] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.246597] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.248218] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.248360] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c5e3a29-0bf9-4a6e-acfc-b7c273d94476 is going to be deleted. [ 1055.249870] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.250068] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.250068] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.250258] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.250369] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.250442] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22d201b2-e74f-4e6f-8cd0-dcaa4db40f3b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.250647] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.250750] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.301619] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.301619] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.306226] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.306327] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee79fa8c-44ea-481b-acf3-ba71ab1ad09a is going to be deleted. [ 1055.307662] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.307906] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.326254] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.326475] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.353026] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a97b14a2-a99a-4ce7-8cba-fd84de098977',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.381632] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.381819] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4f83bf4-ed34-4088-a422-46a4d9e5c7e1 is going to be deleted. [ 1055.382788] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.383098] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.401452] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.402621] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('735ba0f8-8502-49b1-93a7-4ac595ca177c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.434911] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.435169] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b7d77ea-cc30-4d0e-9a44-829eda93848d is going to be deleted. [ 1055.436169] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.436456] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.438244] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.438244] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.455809] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.455986] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.500636] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.501136] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 is going to be deleted. [ 1055.503974] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.503974] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.548481] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.548857] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.549889] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.550067] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7544afbe-03f8-421e-b9ed-b038f61ffc17 is going to be deleted. [ 1055.550987] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.551218] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.571985] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.571985] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.584653] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.584799] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 120a53f4-6f9e-423c-b6c7-c18e7f4310a8 is going to be deleted. [ 1055.585839] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.586079] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.622366] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.622526] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c00c3594-d682-43fb-9d53-d5100f161d24 is going to be deleted. [ 1055.623642] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.623913] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.652638] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.652818] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.662042] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.662042] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 is going to be deleted. [ 1055.662893] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.663239] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.667731] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.667914] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.727669] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.727815] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dcaf51d1-3d78-4731-8697-ec542f23f503 is going to be deleted. [ 1055.729141] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.729557] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.729824] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.729907] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b23ffb1-731f-42f8-bb4b-c106291be34d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.730165] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.730374] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.730485] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.730660] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5a629bb-fe88-498c-a120-35da2e141a08" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.731408] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.731584] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.753209] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.766411] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.767262] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.792056] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.792258] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.797039] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d899613-c950-496a-aec6-9bbbbbf253b5 in Status: SUCCESS [ 1055.797039] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.797270] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.797410] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d8fad12-41c9-413e-91de-8c1ff3cf914e is going to be deleted. [ 1055.798434] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.798760] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.798846] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.798956] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e02be8c7-70b1-4488-b079-b1ebf20a733c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.799211] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.799300] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.799380] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.799496] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69913569-f584-45f7-91a4-ec8af89769a9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.800058] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.800239] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.800310] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.800434] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c5e3a29-0bf9-4a6e-acfc-b7c273d94476" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.800565] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.800710] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.800787] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.800897] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee79fa8c-44ea-481b-acf3-ba71ab1ad09a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.801034] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.801183] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.801246] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.801362] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4f83bf4-ed34-4088-a422-46a4d9e5c7e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.801488] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.801627] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.801706] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.801812] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b7d77ea-cc30-4d0e-9a44-829eda93848d" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.802300] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.802454] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.802631] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.802843] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.802981] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.803144] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.803226] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.803342] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7544afbe-03f8-421e-b9ed-b038f61ffc17" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.803467] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.803607] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.803681] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.803799] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-120a53f4-6f9e-423c-b6c7-c18e7f4310a8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.803922] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.804068] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.804142] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.804248] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c00c3594-d682-43fb-9d53-d5100f161d24" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.846261] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.846492] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.846707] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.847040] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.847187] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.847371] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.855975] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a97b14a2-a99a-4ce7-8cba-fd84de098977: rpc.has_security_group_logging(os_id): False [ 1055.903110] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.903342] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.903342] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.903544] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.903594] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.903700] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dcaf51d1-3d78-4731-8697-ec542f23f503" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.903927] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 735ba0f8-8502-49b1-93a7-4ac595ca177c: rpc.has_security_group_logging(os_id): False [ 1055.905041] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b: rpc.has_security_group_logging(os_id): False [ 1055.906679] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.906826] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.906881] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.907121] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.934739] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.934739] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.937291] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.937418] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.937511] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.937511] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.937697] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.937782] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.937867] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 is going to be updated. [ 1055.938968] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.939164] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.949492] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.949724] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.987803] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.988232] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.988387] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.988442] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.988731] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.988820] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.988934] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c is going to be updated. [ 1055.990705] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.990938] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.009641] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.010616] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.055045] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.055045] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.055308] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.055308] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.055588] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.055725] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.055863] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b is going to be updated. [ 1056.057843] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.057843] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.058021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.058164] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d8fad12-41c9-413e-91de-8c1ff3cf914e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.085594] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.085831] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.085831] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.086019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.086182] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.124690] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 in Status: IN_PROGRESS for 2s [ 1056.153684] env[65943]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1056.154456] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.154728] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.154851] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.155073] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.155232] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.157427] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.157586] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.157658] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.157806] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.157956] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.193730] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b in Status: IN_PROGRESS for 2s [ 1056.194768] env[65943]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1056.195228] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c in Status: IN_PROGRESS for 2s [ 1056.255954] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.406749] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 in Status: SUCCESS [ 1056.406749] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 deletion is rescheduled due to dependency. [ 1056.406749] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.759054] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.759298] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.759370] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.759597] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.759685] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.759792] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9b127ff-135f-4cd2-9456-bc11d98737ce is going to be updated. [ 1056.790354] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.790558] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.790606] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.790929] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.791140] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.800840] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b127ff-135f-4cd2-9456-bc11d98737ce in Status: IN_PROGRESS for 2s [ 1057.810651] env[65943]: INFO networking_nsxv3.common.synchronization [req-85e40e10-b062-42e4-9eec-f7441b89b9a1 req-ca395e3d-0851-411e-939d-bc527377c172 tempest-AttachInterfacesTestJSON-882476571 tempest-AttachInterfacesTestJSON-882476571-project-member] Enqueued Resource ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c with Priority: HIGHEST for action security_group_members [ 1057.810651] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c with Priority: HIGHEST for action security_group_members [ 1057.810651] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-735ba0f8-8502-49b1-93a7-4ac595ca177c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.810651] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.810651] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.810651] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.810651] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.810651] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.810651] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.810651] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.810651] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.811493] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('735ba0f8-8502-49b1-93a7-4ac595ca177c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.139740] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 in Status: SUCCESS [ 1058.139740] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.143947] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-916 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.143947] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-916" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.144199] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-916" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.144391] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-916" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.144669] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.144829] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.144942] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.145172] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.145316] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.145519] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1058.145631] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1058.145738] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1058.145846] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1058.145950] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1058.146074] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1058.146220] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1058.164588] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1058.164762] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1058.164898] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1058.165083] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-916" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.166323] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-981c93b1-ed6c-4184-9172-8ea25aad2ea8 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.166323] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-981c93b1-ed6c-4184-9172-8ea25aad2ea8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.166323] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-981c93b1-ed6c-4184-9172-8ea25aad2ea8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.166323] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-981c93b1-ed6c-4184-9172-8ea25aad2ea8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.166323] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('981c93b1-ed6c-4184-9172-8ea25aad2ea8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.210129] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c in Status: SUCCESS [ 1058.210129] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.210129] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b in Status: SUCCESS [ 1058.210129] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.313695] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('735ba0f8-8502-49b1-93a7-4ac595ca177c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.669311] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.669708] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.669866] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.670247] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.670482] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.670743] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port 981c93b1-ed6c-4184-9172-8ea25aad2ea8 not found, creating... [ 1058.671143] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.671413] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.671708] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.671981] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.672224] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.672616] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.672870] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.673089] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.673397] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.673629] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.673855] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: 981c93b1-ed6c-4184-9172-8ea25aad2ea8 is going to be created. [ 1058.696784] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.696992] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.697068] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.697340] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.697567] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.697784] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-981c93b1-ed6c-4184-9172-8ea25aad2ea8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.813824] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b127ff-135f-4cd2-9456-bc11d98737ce in Status: SUCCESS [ 1058.814174] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.814300] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.814538] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.814737] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.814860] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.814982] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.815099] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.815185] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.815295] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.815392] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.817405] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('735ba0f8-8502-49b1-93a7-4ac595ca177c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.317839] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b127ff-135f-4cd2-9456-bc11d98737ce taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.317980] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.318060] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.318282] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.318437] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.318539] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.318715] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.318874] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.318959] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.319076] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.319227] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b127ff-135f-4cd2-9456-bc11d98737ce taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.319395] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.319460] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.319643] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.319818] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.320498] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.320576] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.320729] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.320807] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.320889] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.320977] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.322082] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.322178] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.322259] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.322580] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.322666] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.322758] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c is going to be updated. [ 1059.353934] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.354125] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.354167] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.354367] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.354532] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.367298] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c in Status: IN_PROGRESS for 2s [ 1059.413618] env[65943]: INFO networking_nsxv3.common.synchronization [req-85e40e10-b062-42e4-9eec-f7441b89b9a1 req-ff179367-5c2c-47e9-9f45-20e3ae658cb3 service nova] Enqueued Resource ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c with Priority: HIGHEST for action security_group_rules [ 1059.413858] env[65943]: INFO networking_nsxv3.common.synchronization [req-85e40e10-b062-42e4-9eec-f7441b89b9a1 req-ff179367-5c2c-47e9-9f45-20e3ae658cb3 service nova] Enqueued Resource ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c with Priority: HIGHEST for action security_group_members [ 1059.414064] env[65943]: INFO networking_nsxv3.common.synchronization [req-85e40e10-b062-42e4-9eec-f7441b89b9a1 req-ff179367-5c2c-47e9-9f45-20e3ae658cb3 service nova] Enqueued Resource ID: 981c93b1-ed6c-4184-9172-8ea25aad2ea8 with Priority: HIGHEST for action port [ 1059.414626] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c with Priority: HIGHEST for action security_group_rules [ 1059.414763] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c with Priority: HIGHEST for action security_group_members [ 1059.414864] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 981c93b1-ed6c-4184-9172-8ea25aad2ea8 with Priority: HIGHEST for action port [ 1059.415543] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-735ba0f8-8502-49b1-93a7-4ac595ca177c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.415818] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.415931] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.416763] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.417058] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('735ba0f8-8502-49b1-93a7-4ac595ca177c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.418990] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-735ba0f8-8502-49b1-93a7-4ac595ca177c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.419125] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.419440] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-981c93b1-ed6c-4184-9172-8ea25aad2ea8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.419568] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-981c93b1-ed6c-4184-9172-8ea25aad2ea8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.419626] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-981c93b1-ed6c-4184-9172-8ea25aad2ea8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.419956] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-981c93b1-ed6c-4184-9172-8ea25aad2ea8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.420153] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('981c93b1-ed6c-4184-9172-8ea25aad2ea8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.825018] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9b127ff-135f-4cd2-9456-bc11d98737ce: rpc.has_security_group_logging(os_id): False [ 1059.845103] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.845494] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.845614] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.845961] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.846137] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.846450] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.846595] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.846703] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.846928] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.847136] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.847269] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.847364] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.847424] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.847592] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.847672] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.847905] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.848033] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.848115] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.848227] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.848306] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.848389] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9b127ff-135f-4cd2-9456-bc11d98737ce is going to be updated. [ 1059.920289] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.920289] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.920289] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.920289] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.920289] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.922573] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-735ba0f8-8502-49b1-93a7-4ac595ca177c taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.924030] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.924030] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 981c93b1-ed6c-4184-9172-8ea25aad2ea8 with status ACTIVE [ 1059.924030] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.924030] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.924030] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.924030] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.924030] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.924030] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.924323] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.924323] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.924323] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.924411] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.924819] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.924924] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.924961] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.925226] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.925622] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.925622] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 981c93b1-ed6c-4184-9172-8ea25aad2ea8 is going to be updated. [ 1059.935830] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9b127ff-135f-4cd2-9456-bc11d98737ce in Status: IN_PROGRESS for 2s [ 1059.947115] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.947115] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.947115] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.947115] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.947115] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.947396] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-981c93b1-ed6c-4184-9172-8ea25aad2ea8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.151534] env[65943]: INFO networking_nsxv3.common.synchronization [req-0917d547-08b2-4114-950f-cdde655311a3 req-cebab454-d05f-4334-81aa-486c6b50a0b3 tempest-ServersV294TestFqdnHostnames-134123508 tempest-ServersV294TestFqdnHostnames-134123508-project-member] Enqueued Resource ID: 6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b with Priority: HIGHEST for action security_group_members [ 1061.152195] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b with Priority: HIGHEST for action security_group_members [ 1061.152471] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.152638] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.152712] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.152935] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.153108] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.153215] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.153314] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.153440] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.154916] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.154916] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.161532] env[65943]: INFO networking_nsxv3.common.synchronization [req-02713d28-cecc-4ff5-b735-d706df42f24c req-60d690f7-a66d-4991-9101-cf3529c4a13d tempest-DeleteServersTestJSON-1404918926 tempest-DeleteServersTestJSON-1404918926-project-member] Enqueued Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_members [ 1061.161532] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_members [ 1061.161887] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.162031] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.162105] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.162784] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.162784] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.162784] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.162784] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.162784] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.163195] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.163195] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.379520] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c in Status: SUCCESS [ 1061.379825] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.379980] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.380880] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.380880] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.380880] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.380880] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.381114] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.381114] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.381193] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('735ba0f8-8502-49b1-93a7-4ac595ca177c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.616690] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-749 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.616888] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-749" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.617020] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-749" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.617281] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-749" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.617556] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.617685] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.617800] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.618167] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.618312] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.618596] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1061.618731] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1061.618769] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1061.618904] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1061.618967] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1061.619062] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1061.619192] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1061.642604] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1061.642807] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1061.643119] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1061.643204] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-749" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.643460] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-bf64281e-6176-412c-8477-c2733f004c39 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.643635] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-bf64281e-6176-412c-8477-c2733f004c39" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.643823] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-bf64281e-6176-412c-8477-c2733f004c39" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.644202] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-bf64281e-6176-412c-8477-c2733f004c39" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.644342] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf64281e-6176-412c-8477-c2733f004c39',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.657897] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.658194] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.658194] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.658440] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.658440] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.658797] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.658932] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.659034] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.659188] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.659370] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.659370] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b is going to be updated. [ 1061.665245] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.665448] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.665573] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.665672] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.665845] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.666116] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.666116] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.666116] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.666395] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.666395] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.666395] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 is going to be deleted. [ 1061.690788] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.691067] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.691067] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.691233] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.691376] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.694558] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.694646] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.694685] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.694952] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.695124] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.695192] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.701919] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b in Status: IN_PROGRESS for 2s [ 1061.884833] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('735ba0f8-8502-49b1-93a7-4ac595ca177c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.948756] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9b127ff-135f-4cd2-9456-bc11d98737ce in Status: SUCCESS [ 1061.948986] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.146795] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.147036] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.147152] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.147449] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.147601] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.147759] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port bf64281e-6176-412c-8477-c2733f004c39 not found, creating... [ 1062.148030] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.148201] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.148306] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.148516] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.148699] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.149043] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.149225] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.149344] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.149691] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.149691] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.149828] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: bf64281e-6176-412c-8477-c2733f004c39 is going to be created. [ 1062.171759] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.171981] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.172119] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.172468] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.172797] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.173028] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-bf64281e-6176-412c-8477-c2733f004c39" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.388033] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('735ba0f8-8502-49b1-93a7-4ac595ca177c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.890130] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.890347] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.890425] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.890667] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.890787] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.890903] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c is going to be updated. [ 1062.923702] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.923702] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.923702] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.923702] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.923702] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.931844] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c in Status: IN_PROGRESS for 2s [ 1063.026723] env[65943]: INFO networking_nsxv3.common.synchronization [req-02713d28-cecc-4ff5-b735-d706df42f24c req-e97bfa44-83d8-431a-8c8f-c0593c8a5c97 service nova] Enqueued Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_rules [ 1063.030497] env[65943]: INFO networking_nsxv3.common.synchronization [req-02713d28-cecc-4ff5-b735-d706df42f24c req-e97bfa44-83d8-431a-8c8f-c0593c8a5c97 service nova] Enqueued Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_members [ 1063.030497] env[65943]: INFO networking_nsxv3.common.synchronization [req-02713d28-cecc-4ff5-b735-d706df42f24c req-e97bfa44-83d8-431a-8c8f-c0593c8a5c97 service nova] Enqueued Resource ID: bf64281e-6176-412c-8477-c2733f004c39 with Priority: HIGHEST for action port [ 1063.030497] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_rules [ 1063.030497] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_members [ 1063.030497] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf64281e-6176-412c-8477-c2733f004c39 with Priority: HIGHEST for action port [ 1063.030497] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.030497] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.030497] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.030497] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.030497] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.030497] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.030497] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.032186] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.033151] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.035261] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.035375] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.035586] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.036353] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.036353] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.036353] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.038160] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf64281e-6176-412c-8477-c2733f004c39 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.038288] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf64281e-6176-412c-8477-c2733f004c39" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.038365] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf64281e-6176-412c-8477-c2733f004c39" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.038770] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf64281e-6176-412c-8477-c2733f004c39" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.038770] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf64281e-6176-412c-8477-c2733f004c39',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.539026] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.540794] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.540794] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.540794] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf64281e-6176-412c-8477-c2733f004c39 with status ACTIVE [ 1063.540946] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.541135] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.541135] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.541848] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.541848] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.541848] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.541848] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.541848] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.541848] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.542367] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.542367] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.542367] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.542367] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.542508] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.542508] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.542573] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf64281e-6176-412c-8477-c2733f004c39 is going to be updated. [ 1063.569170] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.569377] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.570181] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.570181] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.570181] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.570181] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf64281e-6176-412c-8477-c2733f004c39" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.716135] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b in Status: SUCCESS [ 1063.716365] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b deletion is rescheduled due to dependency. [ 1063.716450] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.042737] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.546146] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.546541] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.546541] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.546820] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.546820] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.546944] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 is going to be created. [ 1064.573189] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.573189] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.573189] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.573443] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.573706] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.593840] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: UNINITIALIZED for 2s [ 1064.699695] env[65943]: INFO networking_nsxv3.common.synchronization [req-57068413-4784-4e3c-903c-abd1099c8c04 req-06c8e291-a191-413d-b8fe-e786197f17a4 tempest-ServerActionsTestOtherB-2092325239 tempest-ServerActionsTestOtherB-2092325239-project-member] Enqueued Resource ID: 2880c629-d8d0-45b5-b939-d99c78caab70 with Priority: HIGHEST for action security_group_members [ 1064.699695] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2880c629-d8d0-45b5-b939-d99c78caab70 with Priority: HIGHEST for action security_group_members [ 1064.701794] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2880c629-d8d0-45b5-b939-d99c78caab70 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.701794] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.701794] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.702091] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.702145] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.702291] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.702478] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.702580] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.702768] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.702848] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2880c629-d8d0-45b5-b939-d99c78caab70',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.946022] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c in Status: SUCCESS [ 1064.946022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.946022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.946022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.946022] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.946022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.946022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.946022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.946022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.946022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.946022] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('735ba0f8-8502-49b1-93a7-4ac595ca177c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.203140] env[65943]: INFO networking_nsxv3.common.synchronization [req-57c0bcdf-5203-4c6b-8d82-d143f0621d06 req-42364f30-65a7-4a14-9400-bb36f1ee93f1 tempest-ServersTestManualDisk-467634811 tempest-ServersTestManualDisk-467634811-project-member] Enqueued Resource ID: 2b092468-bc6e-49b4-be83-babaf5ab0786 with Priority: HIGHEST for action security_group_members [ 1065.203824] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b092468-bc6e-49b4-be83-babaf5ab0786 with Priority: HIGHEST for action security_group_members [ 1065.204176] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b092468-bc6e-49b4-be83-babaf5ab0786 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.204299] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b092468-bc6e-49b4-be83-babaf5ab0786" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.204382] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b092468-bc6e-49b4-be83-babaf5ab0786" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.204973] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b092468-bc6e-49b4-be83-babaf5ab0786" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.205281] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.205390] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.205455] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.205627] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.205730] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.205827] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b092468-bc6e-49b4-be83-babaf5ab0786',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.208637] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.208764] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.208820] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.209060] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.240479] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.240793] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.240973] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.241074] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.241326] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.241416] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.241512] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2880c629-d8d0-45b5-b939-d99c78caab70 is going to be updated. [ 1065.272313] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.272313] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.272313] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.272313] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.272313] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.281088] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2880c629-d8d0-45b5-b939-d99c78caab70 in Status: IN_PROGRESS for 2s [ 1065.449046] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('735ba0f8-8502-49b1-93a7-4ac595ca177c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.708276] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.708680] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.708680] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.708680] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.742719] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.744369] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.744521] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.744568] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.745679] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.745679] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.745679] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b092468-bc6e-49b4-be83-babaf5ab0786 is going to be updated. [ 1065.779861] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.780090] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.780164] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.780394] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.780537] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.792775] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b092468-bc6e-49b4-be83-babaf5ab0786 in Status: IN_PROGRESS for 2s [ 1065.952082] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 735ba0f8-8502-49b1-93a7-4ac595ca177c: rpc.has_security_group_logging(os_id): False [ 1065.972046] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.973292] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.973292] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.973292] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.973292] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.975863] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.975863] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.975863] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.975863] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.975863] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.975863] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c is going to be updated. [ 1066.053496] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.054784] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.054876] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.055124] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.055752] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.076487] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c in Status: IN_PROGRESS for 2s [ 1066.605797] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: SUCCESS [ 1066.606822] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.606822] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.606822] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.606822] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.606822] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.607054] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.607054] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.607124] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.607205] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.607296] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.923881] env[65943]: INFO networking_nsxv3.common.synchronization [None req-b7c7757a-b304-47bd-afb4-182b54a84197 None None] Enqueued Resource ID: ab80df87-d993-48ac-ac4e-dca0ebaeda34 with Priority: HIGHEST for action port [ 1066.925176] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab80df87-d993-48ac-ac4e-dca0ebaeda34 with Priority: HIGHEST for action port [ 1066.925176] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab80df87-d993-48ac-ac4e-dca0ebaeda34 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.925176] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab80df87-d993-48ac-ac4e-dca0ebaeda34" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.925176] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab80df87-d993-48ac-ac4e-dca0ebaeda34" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.926569] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab80df87-d993-48ac-ac4e-dca0ebaeda34" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.926569] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab80df87-d993-48ac-ac4e-dca0ebaeda34',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.110184] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.110317] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.110392] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.112980] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.112980] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.112980] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.112980] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.112980] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.112980] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.112980] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.112980] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.112980] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.112980] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.112980] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.112980] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.112980] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.112980] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.112980] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.112980] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.113513] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.113513] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.257255] env[65943]: INFO networking_nsxv3.common.synchronization [req-5376943e-cc6c-4ac4-903b-2d29435b614b req-f58a0ee6-2ff6-48ae-8f89-aa9fac20e481 tempest-ServerDiskConfigTestJSON-397438939 tempest-ServerDiskConfigTestJSON-397438939-project-member] Enqueued Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_members [ 1067.257775] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9b127ff-135f-4cd2-9456-bc11d98737ce with Priority: HIGHEST for action security_group_members [ 1067.258679] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b127ff-135f-4cd2-9456-bc11d98737ce taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.258679] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.258679] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.258679] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.258679] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.258987] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.258987] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.259183] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.259183] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.259183] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9b127ff-135f-4cd2-9456-bc11d98737ce',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.292225] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2880c629-d8d0-45b5-b939-d99c78caab70 in Status: SUCCESS [ 1067.292412] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2880c629-d8d0-45b5-b939-d99c78caab70 deletion is rescheduled due to dependency. [ 1067.292525] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.429229] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ab80df87-d993-48ac-ac4e-dca0ebaeda34 [ 1067.429457] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.430309] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.430309] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.430309] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.430309] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.430309] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ab80df87-d993-48ac-ac4e-dca0ebaeda34 already deleted. [ 1067.430309] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab80df87-d993-48ac-ac4e-dca0ebaeda34" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.615411] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15454ceb-9062-41fb-908b-b5ae144dbe65: rpc.has_security_group_logging(os_id): False [ 1067.633974] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.634306] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.634306] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.634491] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.634571] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.634817] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.634972] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.634972] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.635189] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.635257] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.635412] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.635512] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.635581] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.635710] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.635788] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.636015] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.636323] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.636408] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.636690] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.636791] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.636924] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 is going to be created. [ 1067.697839] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.698172] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.698320] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.698657] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.698981] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.722599] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: IN_PROGRESS for 2s [ 1067.762352] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.762507] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.762549] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.762824] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.762927] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.763163] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.763311] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.763311] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.763472] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.763624] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.763688] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9b127ff-135f-4cd2-9456-bc11d98737ce is going to be updated. [ 1067.816546] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.816546] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.816546] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.816793] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.816982] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.819084] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b092468-bc6e-49b4-be83-babaf5ab0786 in Status: SUCCESS [ 1067.819260] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b092468-bc6e-49b4-be83-babaf5ab0786 deletion is rescheduled due to dependency. [ 1067.819370] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b092468-bc6e-49b4-be83-babaf5ab0786" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.836685] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b127ff-135f-4cd2-9456-bc11d98737ce in Status: IN_PROGRESS for 2s [ 1068.095289] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c in Status: SUCCESS [ 1068.095596] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.654311] env[65943]: INFO networking_nsxv3.common.synchronization [None req-ab4b86ae-69a1-4dd2-97bc-81876cc77cb4 tempest-AttachVolumeTestJSON-1035762737 tempest-AttachVolumeTestJSON-1035762737-project-member] Enqueued Resource ID: a3785ccf-0b13-4a67-ba63-81d28e609f6b with Priority: HIGHEST for action security_group_rules [ 1068.654725] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3785ccf-0b13-4a67-ba63-81d28e609f6b with Priority: HIGHEST for action security_group_rules [ 1068.656602] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3785ccf-0b13-4a67-ba63-81d28e609f6b taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.656602] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3785ccf-0b13-4a67-ba63-81d28e609f6b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.656602] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3785ccf-0b13-4a67-ba63-81d28e609f6b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.656602] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3785ccf-0b13-4a67-ba63-81d28e609f6b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.656602] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3785ccf-0b13-4a67-ba63-81d28e609f6b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.820218] env[65943]: INFO networking_nsxv3.common.synchronization [None req-25bf4367-3f99-476c-bd3d-72d8539ffb37 tempest-AttachVolumeTestJSON-1035762737 tempest-AttachVolumeTestJSON-1035762737-project-member] Enqueued Resource ID: a3785ccf-0b13-4a67-ba63-81d28e609f6b with Priority: HIGHEST for action security_group_rules [ 1068.820679] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3785ccf-0b13-4a67-ba63-81d28e609f6b with Priority: HIGHEST for action security_group_rules [ 1068.821205] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3785ccf-0b13-4a67-ba63-81d28e609f6b taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.821368] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3785ccf-0b13-4a67-ba63-81d28e609f6b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.924740] env[65943]: INFO networking_nsxv3.common.synchronization [None req-08aa3bae-f4ee-4591-855d-0a4fb8dc1d94 None None] Enqueued Resource ID: a37b9e68-561e-4ad1-8c1d-7540e9b24f1e with Priority: HIGHEST for action port [ 1068.924960] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a37b9e68-561e-4ad1-8c1d-7540e9b24f1e with Priority: HIGHEST for action port [ 1068.925636] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-a37b9e68-561e-4ad1-8c1d-7540e9b24f1e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.925746] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a37b9e68-561e-4ad1-8c1d-7540e9b24f1e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.925746] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a37b9e68-561e-4ad1-8c1d-7540e9b24f1e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.925979] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a37b9e68-561e-4ad1-8c1d-7540e9b24f1e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.928680] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a37b9e68-561e-4ad1-8c1d-7540e9b24f1e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.179169] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.181947] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.181947] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.181947] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.181947] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.181947] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3785ccf-0b13-4a67-ba63-81d28e609f6b already deleted. [ 1069.181947] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3785ccf-0b13-4a67-ba63-81d28e609f6b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.181947] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3785ccf-0b13-4a67-ba63-81d28e609f6b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.181947] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3785ccf-0b13-4a67-ba63-81d28e609f6b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.181947] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3785ccf-0b13-4a67-ba63-81d28e609f6b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.229517] env[65943]: INFO networking_nsxv3.common.synchronization [None req-6306f828-4e15-4426-9274-0444e84036da tempest-AttachInterfacesTestJSON-882476571 tempest-AttachInterfacesTestJSON-882476571-project-member] Enqueued Resource ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 with Priority: HIGHEST for action security_group_members [ 1069.230286] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 with Priority: HIGHEST for action security_group_members [ 1069.230679] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8a054b-6bee-465e-84da-d50dfdc27f64 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.230820] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.230892] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.231161] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.231250] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.231377] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.231463] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.231639] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.231721] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.231836] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.431666] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a37b9e68-561e-4ad1-8c1d-7540e9b24f1e [ 1069.431666] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.431999] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.431999] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.432217] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.432316] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.432414] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a37b9e68-561e-4ad1-8c1d-7540e9b24f1e already deleted. [ 1069.432490] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a37b9e68-561e-4ad1-8c1d-7540e9b24f1e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.707827] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.707827] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.707952] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.708105] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.708200] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.708299] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3785ccf-0b13-4a67-ba63-81d28e609f6b already deleted. [ 1069.708381] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3785ccf-0b13-4a67-ba63-81d28e609f6b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.737451] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.737451] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.737451] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.737451] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.737451] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: SUCCESS [ 1069.737876] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.755844] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.756129] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.756251] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.756313] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.756549] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.756667] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.756667] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 is going to be updated. [ 1069.789992] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.790151] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.790222] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.790428] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.790568] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.802924] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 in Status: IN_PROGRESS for 2s [ 1069.847837] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b127ff-135f-4cd2-9456-bc11d98737ce in Status: SUCCESS [ 1069.849572] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9b127ff-135f-4cd2-9456-bc11d98737ce deletion is rescheduled due to dependency. [ 1069.849572] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b127ff-135f-4cd2-9456-bc11d98737ce" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.814297] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 in Status: SUCCESS [ 1071.814642] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 deletion is rescheduled due to dependency. [ 1071.814642] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.060896] env[65943]: INFO networking_nsxv3.common.synchronization [req-adc18edb-8503-42d5-95d0-f70f88298f7b req-401427c8-34df-4323-8666-0e1b2e8c6f2f tempest-ServerRescueNegativeTestJSON-734649129 tempest-ServerRescueNegativeTestJSON-734649129-project-member] Enqueued Resource ID: 2d899613-c950-496a-aec6-9bbbbbf253b5 with Priority: HIGHEST for action security_group_members [ 1074.061547] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d899613-c950-496a-aec6-9bbbbbf253b5 with Priority: HIGHEST for action security_group_members [ 1074.061886] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d899613-c950-496a-aec6-9bbbbbf253b5 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.062158] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.062158] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.062405] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.062457] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.062596] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.062596] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.062747] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.063149] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.063149] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d899613-c950-496a-aec6-9bbbbbf253b5',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.566696] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.566938] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.567030] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.567285] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.593386] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.593386] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.593586] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.593586] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.593699] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.593781] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.593880] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d899613-c950-496a-aec6-9bbbbbf253b5 is going to be updated. [ 1074.641172] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.641314] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.641379] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.641640] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.641734] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.651323] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d899613-c950-496a-aec6-9bbbbbf253b5 in Status: IN_PROGRESS for 2s [ 1075.636507] env[65943]: INFO networking_nsxv3.common.synchronization [req-5463cddd-5c94-4e62-a67a-52e6540661ef req-bbb50be5-d781-4044-b207-c80e1fc433d0 tempest-ServerActionsTestJSON-1587559204 tempest-ServerActionsTestJSON-1587559204-project-member] Enqueued Resource ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 with Priority: HIGHEST for action security_group_members [ 1075.637143] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 with Priority: HIGHEST for action security_group_members [ 1075.637500] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bcdadce-edf2-43d0-a8d9-43033bb27e63 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.637623] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.637714] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.637972] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.638152] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.638256] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.638319] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.638508] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.638605] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.638729] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bcdadce-edf2-43d0-a8d9-43033bb27e63',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.998625] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-287 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.999450] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-287" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.999450] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-287" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.999450] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-287" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.999611] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.999702] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.000063] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.000134] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.000267] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.000485] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1076.000597] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1076.000708] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1076.000812] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1076.000915] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1076.001024] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1076.001152] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1076.022946] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1076.023745] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1076.023745] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1076.023745] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-287" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.023918] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-eee9fca6-64ad-402a-878b-ec606b53a0e8 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.024116] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-eee9fca6-64ad-402a-878b-ec606b53a0e8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.024236] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-eee9fca6-64ad-402a-878b-ec606b53a0e8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.024593] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-eee9fca6-64ad-402a-878b-ec606b53a0e8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.024879] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eee9fca6-64ad-402a-878b-ec606b53a0e8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.141166] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.141334] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.141915] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.141915] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.141915] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.141915] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.142190] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.142190] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.142190] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.142297] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.142342] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 is going to be deleted. [ 1076.182743] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.182985] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.182985] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.184092] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.184092] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.184092] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.528183] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.528417] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.528470] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.528840] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.528998] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.528998] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port eee9fca6-64ad-402a-878b-ec606b53a0e8 not found, creating... [ 1076.528998] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.529821] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.529821] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.530050] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.530330] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.530508] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.530730] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.530862] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.531096] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.531233] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.531373] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: eee9fca6-64ad-402a-878b-ec606b53a0e8 is going to be created. [ 1076.561301] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.561728] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.561964] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.562282] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.562564] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.562846] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-eee9fca6-64ad-402a-878b-ec606b53a0e8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.665174] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d899613-c950-496a-aec6-9bbbbbf253b5 in Status: SUCCESS [ 1076.665174] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d899613-c950-496a-aec6-9bbbbbf253b5 deletion is rescheduled due to dependency. [ 1076.665917] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d899613-c950-496a-aec6-9bbbbbf253b5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.348651] env[65943]: INFO networking_nsxv3.common.synchronization [req-5463cddd-5c94-4e62-a67a-52e6540661ef req-a1365645-4140-45ca-9a53-12dd0a631025 service nova] Enqueued Resource ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 with Priority: HIGHEST for action security_group_rules [ 1077.348651] env[65943]: INFO networking_nsxv3.common.synchronization [req-5463cddd-5c94-4e62-a67a-52e6540661ef req-a1365645-4140-45ca-9a53-12dd0a631025 service nova] Enqueued Resource ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 with Priority: HIGHEST for action security_group_members [ 1077.348651] env[65943]: INFO networking_nsxv3.common.synchronization [req-5463cddd-5c94-4e62-a67a-52e6540661ef req-a1365645-4140-45ca-9a53-12dd0a631025 service nova] Enqueued Resource ID: eee9fca6-64ad-402a-878b-ec606b53a0e8 with Priority: HIGHEST for action port [ 1077.348921] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 with Priority: HIGHEST for action security_group_rules [ 1077.349037] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 with Priority: HIGHEST for action security_group_members [ 1077.349167] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eee9fca6-64ad-402a-878b-ec606b53a0e8 with Priority: HIGHEST for action port [ 1077.349384] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.349502] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.349571] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.349815] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.350453] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7bcdadce-edf2-43d0-a8d9-43033bb27e63',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.350779] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bcdadce-edf2-43d0-a8d9-43033bb27e63 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.350889] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.350952] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.351140] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.351293] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.351382] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.351443] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.352119] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.352119] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.352119] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bcdadce-edf2-43d0-a8d9-43033bb27e63',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.352747] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-eee9fca6-64ad-402a-878b-ec606b53a0e8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.352856] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eee9fca6-64ad-402a-878b-ec606b53a0e8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.353779] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eee9fca6-64ad-402a-878b-ec606b53a0e8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.353779] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eee9fca6-64ad-402a-878b-ec606b53a0e8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.353779] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eee9fca6-64ad-402a-878b-ec606b53a0e8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.855171] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bcdadce-edf2-43d0-a8d9-43033bb27e63 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.855562] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.855562] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7bcdadce-edf2-43d0-a8d9-43033bb27e63',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.856596] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eee9fca6-64ad-402a-878b-ec606b53a0e8 with status ACTIVE [ 1077.856720] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.856785] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.856850] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.857070] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.857169] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.857364] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.857531] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.857591] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.857758] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.857838] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.858042] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.858140] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.858220] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.858340] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.858414] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.858500] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eee9fca6-64ad-402a-878b-ec606b53a0e8 is going to be updated. [ 1077.884569] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.884751] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.884751] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.884944] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.885275] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.885275] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eee9fca6-64ad-402a-878b-ec606b53a0e8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.092759] env[65943]: INFO networking_nsxv3.common.synchronization [req-79279a4b-639f-4326-839e-9dfc15f7f84f req-a0b84612-ad5e-4597-be1b-b6d15b9685a1 tempest-DeleteServersTestJSON-1404918926 tempest-DeleteServersTestJSON-1404918926-project-member] Enqueued Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_members [ 1078.093451] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_members [ 1078.093922] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.095986] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.095986] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.095986] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.095986] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.095986] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.095986] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.095986] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.095986] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.095986] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.360557] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7bcdadce-edf2-43d0-a8d9-43033bb27e63',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.599143] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.599143] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.599143] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.599143] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.599143] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.599341] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.599634] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.599855] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.600252] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.600433] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.600749] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 is going to be updated. [ 1078.632559] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.632559] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.632559] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.632788] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.633434] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.642116] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: IN_PROGRESS for 2s [ 1078.866223] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.866223] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.866223] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.866223] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.866223] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.866223] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 is going to be created. [ 1078.891690] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.891690] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.891690] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.891690] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.891690] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.903526] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 in Status: UNINITIALIZED for 2s [ 1079.171659] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-916 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.171859] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-916" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.171984] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-916" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.172321] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-916" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.173028] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.173028] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.173028] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.173028] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.173234] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.173358] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1079.173471] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1079.173590] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1079.173716] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1079.173806] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1079.174248] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1079.174248] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1079.195247] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1079.195247] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1079.195247] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1079.195247] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-916" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.195566] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-bd45e6b4-5e04-4f01-a2d3-3f64a56215f7 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.195743] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-bd45e6b4-5e04-4f01-a2d3-3f64a56215f7" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.195861] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-bd45e6b4-5e04-4f01-a2d3-3f64a56215f7" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.196268] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-bd45e6b4-5e04-4f01-a2d3-3f64a56215f7" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.196401] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd45e6b4-5e04-4f01-a2d3-3f64a56215f7',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.700038] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.700258] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.700381] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.700664] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.700813] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.700969] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port bd45e6b4-5e04-4f01-a2d3-3f64a56215f7 not found, creating... [ 1079.701247] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.701402] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.701517] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.701744] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.701876] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.702174] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.702328] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.702444] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.702649] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.702780] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.702917] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: bd45e6b4-5e04-4f01-a2d3-3f64a56215f7 is going to be created. [ 1079.727534] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.727797] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.727858] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.728156] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.728395] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.728613] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-bd45e6b4-5e04-4f01-a2d3-3f64a56215f7" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.446752] env[65943]: INFO networking_nsxv3.common.synchronization [req-1ea79e94-4f30-4290-82ad-70f482725d39 req-9880c7da-2f51-45ff-959a-8ea6e09f8172 service nova] Enqueued Resource ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 with Priority: HIGHEST for action security_group_rules [ 1080.447285] env[65943]: INFO networking_nsxv3.common.synchronization [req-1ea79e94-4f30-4290-82ad-70f482725d39 req-9880c7da-2f51-45ff-959a-8ea6e09f8172 service nova] Enqueued Resource ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 with Priority: HIGHEST for action security_group_members [ 1080.447285] env[65943]: INFO networking_nsxv3.common.synchronization [req-1ea79e94-4f30-4290-82ad-70f482725d39 req-9880c7da-2f51-45ff-959a-8ea6e09f8172 service nova] Enqueued Resource ID: bd45e6b4-5e04-4f01-a2d3-3f64a56215f7 with Priority: HIGHEST for action port [ 1080.448109] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 with Priority: HIGHEST for action security_group_rules [ 1080.448311] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 with Priority: HIGHEST for action security_group_members [ 1080.448464] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd45e6b4-5e04-4f01-a2d3-3f64a56215f7 with Priority: HIGHEST for action port [ 1080.448956] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c8a054b-6bee-465e-84da-d50dfdc27f64 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.449040] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.449123] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.449342] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.449438] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.451083] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8a054b-6bee-465e-84da-d50dfdc27f64 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.451083] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.451083] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.451083] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.451271] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.451650] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.451650] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.451786] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.451832] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.451932] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.455446] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd45e6b4-5e04-4f01-a2d3-3f64a56215f7 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.455446] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd45e6b4-5e04-4f01-a2d3-3f64a56215f7" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.455446] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd45e6b4-5e04-4f01-a2d3-3f64a56215f7" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.455647] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd45e6b4-5e04-4f01-a2d3-3f64a56215f7" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.455852] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd45e6b4-5e04-4f01-a2d3-3f64a56215f7',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.655441] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: IN_PROGRESS for 4s [ 1080.914978] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 in Status: SUCCESS [ 1080.915324] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.915517] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.915815] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.916082] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.916216] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.916284] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.916455] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.916537] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.916786] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.916884] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7bcdadce-edf2-43d0-a8d9-43033bb27e63',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.957992] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.959087] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8a054b-6bee-465e-84da-d50dfdc27f64 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.959204] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.961070] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bd45e6b4-5e04-4f01-a2d3-3f64a56215f7 with status ACTIVE [ 1080.961287] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.961406] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.961457] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.961653] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.961735] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.961908] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.961998] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.962074] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.962226] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.962305] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.962473] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.962559] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.962642] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.962749] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.962821] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.962903] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bd45e6b4-5e04-4f01-a2d3-3f64a56215f7 is going to be updated. [ 1080.988190] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.988389] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.988439] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.988639] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.988875] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.989063] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd45e6b4-5e04-4f01-a2d3-3f64a56215f7" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.419531] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7bcdadce-edf2-43d0-a8d9-43033bb27e63',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.461778] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.670131] env[65943]: INFO networking_nsxv3.common.synchronization [req-83506508-1133-427b-81bf-d34d9d68a3bb req-e9745d13-021d-4c13-ad4d-a3e9948d879c tempest-ServersTestMultiNic-1452946458 tempest-ServersTestMultiNic-1452946458-project-member] Enqueued Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_members [ 1081.670810] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_members [ 1081.671289] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.671418] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.671503] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.671773] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.671899] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.671997] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.672072] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.672270] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.672338] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.672446] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.921694] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7bcdadce-edf2-43d0-a8d9-43033bb27e63: rpc.has_security_group_logging(os_id): False [ 1081.940526] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.940762] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.940762] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.940874] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.940966] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.941302] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.941402] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.941642] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.941642] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.941725] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.941764] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 is going to be created. [ 1081.965830] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.966025] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.966082] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.966282] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.966374] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.966478] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 is going to be updated. [ 1081.993797] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.993940] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.994306] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.994306] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.994393] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.002853] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.002853] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.002853] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.003086] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.003264] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.005485] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 in Status: IN_PROGRESS for 2s [ 1082.013327] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 in Status: IN_PROGRESS for 2s [ 1082.031283] env[65943]: INFO networking_nsxv3.common.synchronization [req-83506508-1133-427b-81bf-d34d9d68a3bb req-3c3ac057-54fe-4176-8183-c6986e645bec tempest-ServersTestMultiNic-1452946458 tempest-ServersTestMultiNic-1452946458-project-member] Enqueued Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_members [ 1082.032334] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_members [ 1082.032885] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.032989] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.179088] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.179088] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.179088] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.179088] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.179088] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.179088] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.179088] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.179088] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.179088] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.179088] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.179088] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 is going to be updated. [ 1082.208056] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.208346] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.208425] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.208875] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.208875] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.219820] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 in Status: IN_PROGRESS for 2s [ 1082.402348] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-554 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.402545] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-554" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.402702] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-554" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.403063] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-554" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.403332] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.403510] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.403837] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.404152] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.404368] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.404624] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1082.404775] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1082.404919] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1082.405093] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1082.405252] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1082.405393] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1082.405560] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1082.431660] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1082.432249] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1082.432488] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1082.432674] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-554" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.433067] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-5f8d7952-0aee-4989-9b87-8e68379b6b09 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.433258] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-5f8d7952-0aee-4989-9b87-8e68379b6b09" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.433429] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-5f8d7952-0aee-4989-9b87-8e68379b6b09" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.433770] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-5f8d7952-0aee-4989-9b87-8e68379b6b09" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.433953] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f8d7952-0aee-4989-9b87-8e68379b6b09',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.684624] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: SUCCESS [ 1082.685025] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 deletion is rescheduled due to dependency. [ 1082.685150] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.937137] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.937415] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.937548] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.938144] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.938517] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.938760] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port 5f8d7952-0aee-4989-9b87-8e68379b6b09 not found, creating... [ 1082.939009] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.939175] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.939289] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.939508] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.939646] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.939941] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.940121] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.940239] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.940442] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.940575] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.940710] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: 5f8d7952-0aee-4989-9b87-8e68379b6b09 is going to be created. [ 1082.970280] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.970485] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.970611] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.970958] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.971308] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.971533] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-5f8d7952-0aee-4989-9b87-8e68379b6b09" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.719936] env[65943]: INFO networking_nsxv3.common.synchronization [req-83506508-1133-427b-81bf-d34d9d68a3bb req-218b7eda-c769-41e4-a003-5b5e946b7dbd service nova] Enqueued Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_rules [ 1083.719936] env[65943]: INFO networking_nsxv3.common.synchronization [req-83506508-1133-427b-81bf-d34d9d68a3bb req-218b7eda-c769-41e4-a003-5b5e946b7dbd service nova] Enqueued Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_members [ 1083.719936] env[65943]: INFO networking_nsxv3.common.synchronization [req-83506508-1133-427b-81bf-d34d9d68a3bb req-218b7eda-c769-41e4-a003-5b5e946b7dbd service nova] Enqueued Resource ID: 5f8d7952-0aee-4989-9b87-8e68379b6b09 with Priority: HIGHEST for action port [ 1083.719936] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_rules [ 1083.719936] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_members [ 1083.719936] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f8d7952-0aee-4989-9b87-8e68379b6b09 with Priority: HIGHEST for action port [ 1083.720718] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-655fa9f8-1f2b-4cc8-b0fa-767189dc0172 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.720882] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.721093] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.721361] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.721494] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.722624] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.723497] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.723741] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f8d7952-0aee-4989-9b87-8e68379b6b09 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.723855] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f8d7952-0aee-4989-9b87-8e68379b6b09" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.723920] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f8d7952-0aee-4989-9b87-8e68379b6b09" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.724124] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f8d7952-0aee-4989-9b87-8e68379b6b09" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.724211] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f8d7952-0aee-4989-9b87-8e68379b6b09',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.963164] env[65943]: INFO networking_nsxv3.common.synchronization [req-8c25d169-0297-4186-81f8-579438ca4cb2 req-dab6a7b6-d28e-4f3b-9f13-16ba400ce797 tempest-ImagesOneServerTestJSON-1305494692 tempest-ImagesOneServerTestJSON-1305494692-project-member] Enqueued Resource ID: ac6bded7-e3ef-4cd4-99c3-8bcb18296764 with Priority: HIGHEST for action security_group_members [ 1083.963624] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac6bded7-e3ef-4cd4-99c3-8bcb18296764 with Priority: HIGHEST for action security_group_members [ 1083.963721] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac6bded7-e3ef-4cd4-99c3-8bcb18296764 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.963894] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac6bded7-e3ef-4cd4-99c3-8bcb18296764" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.963967] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac6bded7-e3ef-4cd4-99c3-8bcb18296764" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.964181] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac6bded7-e3ef-4cd4-99c3-8bcb18296764" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.964411] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.965044] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.965044] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.965044] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.965044] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.965044] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac6bded7-e3ef-4cd4-99c3-8bcb18296764',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.016099] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 in Status: SUCCESS [ 1084.016734] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.016993] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.017236] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.017434] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.017540] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.017609] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.017912] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.017912] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.017912] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.018146] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.033385] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 in Status: SUCCESS [ 1084.033656] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.229495] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f8d7952-0aee-4989-9b87-8e68379b6b09 with status ACTIVE [ 1084.229754] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.229860] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.229960] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.230223] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.230355] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.230565] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.230680] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.230742] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.230895] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.231071] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.231284] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.231379] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.231439] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.231585] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.231669] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.231754] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f8d7952-0aee-4989-9b87-8e68379b6b09 is going to be updated. [ 1084.233046] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.233137] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.233956] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 in Status: SUCCESS [ 1084.234141] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 deletion is rescheduled due to dependency. [ 1084.234305] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.234401] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.234572] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.234725] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.234824] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.234888] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.235049] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.235146] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.235242] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.256437] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.256583] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.256669] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.256880] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.257032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.257201] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f8d7952-0aee-4989-9b87-8e68379b6b09" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.468682] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.468682] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.468682] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.468682] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.495616] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.496096] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.496096] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.496204] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.496455] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.496829] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.496829] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac6bded7-e3ef-4cd4-99c3-8bcb18296764 is going to be updated. [ 1084.520218] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8a054b-6bee-465e-84da-d50dfdc27f64 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.520434] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.520488] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.520906] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.520906] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.520998] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.521084] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.521237] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.521438] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.521438] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.521600] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8a054b-6bee-465e-84da-d50dfdc27f64 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.521685] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.521741] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.522079] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.522079] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.522175] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.522244] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.522386] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.522636] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.522636] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.522636] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.529569] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.529569] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.529569] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.529569] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.529569] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.539340] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac6bded7-e3ef-4cd4-99c3-8bcb18296764 in Status: IN_PROGRESS for 2s [ 1084.548020] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-776 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.548020] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-776" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.548020] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-776" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.548020] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-776" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.548020] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.548020] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.548434] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.548810] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.549126] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.549465] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1084.552055] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1084.552055] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1084.552055] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1084.552055] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1084.552055] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1084.552055] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1084.577614] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1084.577614] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1084.577614] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1084.577614] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-776" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.577614] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-a7f68eb3-a0bd-4b7c-bf12-2cc73e0dfdd9 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.578543] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-a7f68eb3-a0bd-4b7c-bf12-2cc73e0dfdd9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.578543] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-a7f68eb3-a0bd-4b7c-bf12-2cc73e0dfdd9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.578543] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-a7f68eb3-a0bd-4b7c-bf12-2cc73e0dfdd9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.578543] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7f68eb3-a0bd-4b7c-bf12-2cc73e0dfdd9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.738680] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.026137] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c8a054b-6bee-465e-84da-d50dfdc27f64: rpc.has_security_group_logging(os_id): False [ 1085.046898] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.047163] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.047277] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.047605] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.047831] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.048110] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.048255] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.048255] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.048437] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.048547] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.048883] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.048994] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.049104] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.049311] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.049678] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.049678] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.049794] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.049945] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.050154] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.050289] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.050456] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 is going to be updated. [ 1085.082452] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.082722] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.082849] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.083205] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.083564] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.083769] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port a7f68eb3-a0bd-4b7c-bf12-2cc73e0dfdd9 not found, creating... [ 1085.087077] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.087077] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.087077] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.087077] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.087077] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.087077] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.087077] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.087077] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.087077] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.087077] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.087557] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: a7f68eb3-a0bd-4b7c-bf12-2cc73e0dfdd9 is going to be created. [ 1085.124415] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.124805] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.125038] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.125428] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.125794] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.126160] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-a7f68eb3-a0bd-4b7c-bf12-2cc73e0dfdd9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.181402] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.181617] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.181617] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.182079] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.182079] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.204012] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 in Status: IN_PROGRESS for 2s [ 1085.242597] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.745246] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.745516] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.745551] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.745777] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.745872] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.745972] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 is going to be updated. [ 1085.773158] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.773334] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.773404] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.773623] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.773767] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.782299] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 in Status: IN_PROGRESS for 2s [ 1085.810730] env[65943]: INFO networking_nsxv3.common.synchronization [req-83506508-1133-427b-81bf-d34d9d68a3bb req-a6e592e3-5ff8-4787-a30e-2c26157dfdc9 service nova] Enqueued Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_rules [ 1085.811020] env[65943]: INFO networking_nsxv3.common.synchronization [req-83506508-1133-427b-81bf-d34d9d68a3bb req-a6e592e3-5ff8-4787-a30e-2c26157dfdc9 service nova] Enqueued Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_members [ 1085.811165] env[65943]: INFO networking_nsxv3.common.synchronization [req-83506508-1133-427b-81bf-d34d9d68a3bb req-a6e592e3-5ff8-4787-a30e-2c26157dfdc9 service nova] Enqueued Resource ID: a7f68eb3-a0bd-4b7c-bf12-2cc73e0dfdd9 with Priority: HIGHEST for action port [ 1085.811851] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_rules [ 1085.812043] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_members [ 1085.812179] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7f68eb3-a0bd-4b7c-bf12-2cc73e0dfdd9 with Priority: HIGHEST for action port [ 1085.812550] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-655fa9f8-1f2b-4cc8-b0fa-767189dc0172 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.812676] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.812943] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.813077] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.813322] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7f68eb3-a0bd-4b7c-bf12-2cc73e0dfdd9 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.813452] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7f68eb3-a0bd-4b7c-bf12-2cc73e0dfdd9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.813537] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7f68eb3-a0bd-4b7c-bf12-2cc73e0dfdd9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.813828] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7f68eb3-a0bd-4b7c-bf12-2cc73e0dfdd9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.813891] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7f68eb3-a0bd-4b7c-bf12-2cc73e0dfdd9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.316321] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a7f68eb3-a0bd-4b7c-bf12-2cc73e0dfdd9 with status ACTIVE [ 1086.316527] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.316683] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.316767] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.316990] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.317095] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.317274] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.317390] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.317464] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.317587] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.317632] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.317887] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.317995] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.318060] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.318203] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.318276] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.318359] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a7f68eb3-a0bd-4b7c-bf12-2cc73e0dfdd9 is going to be updated. [ 1086.344173] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.344323] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.344442] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.344588] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.344721] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.344878] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7f68eb3-a0bd-4b7c-bf12-2cc73e0dfdd9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.550658] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac6bded7-e3ef-4cd4-99c3-8bcb18296764 in Status: SUCCESS [ 1086.550852] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac6bded7-e3ef-4cd4-99c3-8bcb18296764 deletion is rescheduled due to dependency. [ 1086.550966] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac6bded7-e3ef-4cd4-99c3-8bcb18296764" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.216259] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 in Status: SUCCESS [ 1087.216569] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.792783] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 in Status: SUCCESS [ 1087.793034] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.793208] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.793440] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.793792] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.793792] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.793923] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.793995] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.794071] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.794169] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.296430] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.786437] env[65943]: INFO networking_nsxv3.common.synchronization [req-59a94660-6fe9-4d3f-9d76-317e146a8098 req-ea6bde86-8608-4d33-b9a4-bf4d02cb51f4 tempest-ServerActionsTestOtherA-92071881 tempest-ServerActionsTestOtherA-92071881-project-member] Enqueued Resource ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 with Priority: HIGHEST for action security_group_members [ 1088.787012] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 with Priority: HIGHEST for action security_group_members [ 1088.787351] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-89dec01a-fac4-47c6-9d76-7e922dba6ec4 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.787489] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.787575] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.787797] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.787975] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.788087] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.788151] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.788314] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.788400] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.788493] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89dec01a-fac4-47c6-9d76-7e922dba6ec4',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.798823] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.081483] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-863 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.081691] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-863" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.081819] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-863" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.082096] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-863" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.082353] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.082510] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.082626] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.082832] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.082976] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.083830] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1089.083830] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1089.083830] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1089.083830] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1089.083830] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1089.083830] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1089.083830] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1089.104113] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1089.104476] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1089.104747] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1089.105071] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-863" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.105583] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-80f66b6d-d2b5-4012-9253-43d5e77fb97a taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.105901] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-80f66b6d-d2b5-4012-9253-43d5e77fb97a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.106155] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-80f66b6d-d2b5-4012-9253-43d5e77fb97a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.106618] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-80f66b6d-d2b5-4012-9253-43d5e77fb97a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.106908] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80f66b6d-d2b5-4012-9253-43d5e77fb97a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.294806] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.294954] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.294998] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.295235] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.301390] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.301698] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.301698] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.301891] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.302178] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.302359] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 is going to be updated. [ 1089.317981] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.318105] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.318700] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.318700] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.318700] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.318700] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.318886] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 is going to be updated. [ 1089.334070] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.334070] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.334070] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.334070] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.334361] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.342193] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 in Status: IN_PROGRESS for 2s [ 1089.346784] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.346943] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.347094] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.347557] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.347557] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.356096] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 in Status: IN_PROGRESS for 2s [ 1089.609346] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.609575] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.609704] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.610108] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.610272] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.610434] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port 80f66b6d-d2b5-4012-9253-43d5e77fb97a not found, creating... [ 1089.610694] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.610859] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.610980] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.611259] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.611431] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.611748] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.611915] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.612049] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.612264] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.612410] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.612560] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: 80f66b6d-d2b5-4012-9253-43d5e77fb97a is going to be created. [ 1089.638292] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.638526] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.638653] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.638955] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.639209] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.639428] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-80f66b6d-d2b5-4012-9253-43d5e77fb97a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.368887] env[65943]: INFO networking_nsxv3.common.synchronization [req-59a94660-6fe9-4d3f-9d76-317e146a8098 req-d342005b-6574-4114-9aec-021e199c2440 service nova] Enqueued Resource ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 with Priority: HIGHEST for action security_group_rules [ 1090.369166] env[65943]: INFO networking_nsxv3.common.synchronization [req-59a94660-6fe9-4d3f-9d76-317e146a8098 req-d342005b-6574-4114-9aec-021e199c2440 service nova] Enqueued Resource ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 with Priority: HIGHEST for action security_group_members [ 1090.370690] env[65943]: INFO networking_nsxv3.common.synchronization [req-59a94660-6fe9-4d3f-9d76-317e146a8098 req-d342005b-6574-4114-9aec-021e199c2440 service nova] Enqueued Resource ID: 80f66b6d-d2b5-4012-9253-43d5e77fb97a with Priority: HIGHEST for action port [ 1090.370690] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 with Priority: HIGHEST for action security_group_rules [ 1090.370690] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 with Priority: HIGHEST for action security_group_members [ 1090.373814] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80f66b6d-d2b5-4012-9253-43d5e77fb97a with Priority: HIGHEST for action port [ 1090.374321] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-89dec01a-fac4-47c6-9d76-7e922dba6ec4 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.374420] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.374457] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.375819] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.375819] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('89dec01a-fac4-47c6-9d76-7e922dba6ec4',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.376220] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-89dec01a-fac4-47c6-9d76-7e922dba6ec4 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.376328] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.380733] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-80f66b6d-d2b5-4012-9253-43d5e77fb97a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.380733] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-80f66b6d-d2b5-4012-9253-43d5e77fb97a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.380733] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-80f66b6d-d2b5-4012-9253-43d5e77fb97a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.380733] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-80f66b6d-d2b5-4012-9253-43d5e77fb97a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.380733] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80f66b6d-d2b5-4012-9253-43d5e77fb97a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.877010] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-89dec01a-fac4-47c6-9d76-7e922dba6ec4 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.877175] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.881761] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 80f66b6d-d2b5-4012-9253-43d5e77fb97a with status ACTIVE [ 1090.881877] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.881934] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.882084] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.882223] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.882318] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.882501] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.882599] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.882662] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.882812] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.882891] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.883086] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.883177] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.883233] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.883375] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.883533] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.883620] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 80f66b6d-d2b5-4012-9253-43d5e77fb97a is going to be updated. [ 1090.905528] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.905700] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.905728] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.905964] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.906120] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.906279] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-80f66b6d-d2b5-4012-9253-43d5e77fb97a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.014169] env[65943]: INFO networking_nsxv3.common.synchronization [req-aedebed5-772a-4d0a-8b06-3e67c939be78 req-277ef8d6-4362-4e46-85dd-dd8c7b84e39a tempest-AttachVolumeTestJSON-1035762737 tempest-AttachVolumeTestJSON-1035762737-project-member] Enqueued Resource ID: a3785ccf-0b13-4a67-ba63-81d28e609f6b with Priority: HIGHEST for action security_group_members [ 1091.014169] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3785ccf-0b13-4a67-ba63-81d28e609f6b with Priority: HIGHEST for action security_group_members [ 1091.014169] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3785ccf-0b13-4a67-ba63-81d28e609f6b taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.014169] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3785ccf-0b13-4a67-ba63-81d28e609f6b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.014169] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3785ccf-0b13-4a67-ba63-81d28e609f6b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.014420] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3785ccf-0b13-4a67-ba63-81d28e609f6b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.014420] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.014606] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.014721] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.014879] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.014916] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.015098] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3785ccf-0b13-4a67-ba63-81d28e609f6b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.354596] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 in Status: SUCCESS [ 1091.354813] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.355498] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.355722] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.355918] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.356065] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.356135] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.356286] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.356358] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.356441] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.356536] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.359453] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.359453] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.359573] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.359573] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.359654] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.359891] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.360038] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.360169] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.365825] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-102 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.366105] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-102" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.366210] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-102" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.366593] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-102" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.366940] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.367733] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.367733] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.369310] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.369310] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.369310] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1091.369310] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1091.369310] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1091.369310] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1091.369310] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1091.369310] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1091.369310] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1091.378209] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 in Status: SUCCESS [ 1091.378388] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 deletion is rescheduled due to dependency. [ 1091.378502] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.379033] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.379270] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.379457] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.379570] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.379633] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.379810] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.379872] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.379967] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89dec01a-fac4-47c6-9d76-7e922dba6ec4',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.389515] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1091.389709] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1091.389859] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1091.390051] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-102" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.390385] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-554ec2d6-6faa-4555-a9c4-231823a0aafe taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.390558] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-554ec2d6-6faa-4555-a9c4-231823a0aafe" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.390680] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-554ec2d6-6faa-4555-a9c4-231823a0aafe" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.391021] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-554ec2d6-6faa-4555-a9c4-231823a0aafe" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.391170] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('554ec2d6-6faa-4555-a9c4-231823a0aafe',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.518077] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.518246] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.518320] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.518540] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.518631] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.518878] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.519035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.519083] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.519197] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.519274] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.519371] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3785ccf-0b13-4a67-ba63-81d28e609f6b already deleted. [ 1091.519456] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3785ccf-0b13-4a67-ba63-81d28e609f6b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.859101] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.859250] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.863700] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.882868] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('89dec01a-fac4-47c6-9d76-7e922dba6ec4',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.894730] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.895035] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.895143] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.895400] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.895533] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.895686] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port 554ec2d6-6faa-4555-a9c4-231823a0aafe not found, creating... [ 1091.895946] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.896112] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.896231] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.896455] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.896611] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.897069] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.897123] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.897225] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.897462] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.897598] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.897737] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: 554ec2d6-6faa-4555-a9c4-231823a0aafe is going to be created. [ 1091.919937] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.920395] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.920573] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.920897] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.921221] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.921502] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-554ec2d6-6faa-4555-a9c4-231823a0aafe" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.366421] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.384999] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('89dec01a-fac4-47c6-9d76-7e922dba6ec4',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.784289] env[65943]: INFO networking_nsxv3.common.synchronization [req-aedebed5-772a-4d0a-8b06-3e67c939be78 req-edb5d938-e090-40aa-bf27-7ef128464d35 service nova] Enqueued Resource ID: a3785ccf-0b13-4a67-ba63-81d28e609f6b with Priority: HIGHEST for action security_group_rules [ 1092.784824] env[65943]: INFO networking_nsxv3.common.synchronization [req-aedebed5-772a-4d0a-8b06-3e67c939be78 req-edb5d938-e090-40aa-bf27-7ef128464d35 service nova] Enqueued Resource ID: a3785ccf-0b13-4a67-ba63-81d28e609f6b with Priority: HIGHEST for action security_group_members [ 1092.784998] env[65943]: INFO networking_nsxv3.common.synchronization [req-aedebed5-772a-4d0a-8b06-3e67c939be78 req-edb5d938-e090-40aa-bf27-7ef128464d35 service nova] Enqueued Resource ID: 554ec2d6-6faa-4555-a9c4-231823a0aafe with Priority: HIGHEST for action port [ 1092.785688] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3785ccf-0b13-4a67-ba63-81d28e609f6b with Priority: HIGHEST for action security_group_rules [ 1092.786320] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3785ccf-0b13-4a67-ba63-81d28e609f6b with Priority: HIGHEST for action security_group_members [ 1092.787643] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 554ec2d6-6faa-4555-a9c4-231823a0aafe with Priority: HIGHEST for action port [ 1092.787643] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3785ccf-0b13-4a67-ba63-81d28e609f6b taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.787787] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3785ccf-0b13-4a67-ba63-81d28e609f6b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.787787] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3785ccf-0b13-4a67-ba63-81d28e609f6b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.787993] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3785ccf-0b13-4a67-ba63-81d28e609f6b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.788120] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3785ccf-0b13-4a67-ba63-81d28e609f6b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.789202] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3785ccf-0b13-4a67-ba63-81d28e609f6b taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.789202] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3785ccf-0b13-4a67-ba63-81d28e609f6b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.789202] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3785ccf-0b13-4a67-ba63-81d28e609f6b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.789391] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3785ccf-0b13-4a67-ba63-81d28e609f6b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.789539] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.789631] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.789701] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.789892] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.789949] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.790022] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3785ccf-0b13-4a67-ba63-81d28e609f6b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.793578] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-554ec2d6-6faa-4555-a9c4-231823a0aafe taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.793578] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-554ec2d6-6faa-4555-a9c4-231823a0aafe" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.793578] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-554ec2d6-6faa-4555-a9c4-231823a0aafe" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.793578] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-554ec2d6-6faa-4555-a9c4-231823a0aafe" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.793578] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('554ec2d6-6faa-4555-a9c4-231823a0aafe',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.868935] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.869078] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.869161] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.869439] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.869540] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.869650] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 is going to be updated. [ 1092.887234] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.887407] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.887470] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.887683] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.887769] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.887909] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 is going to be updated. [ 1092.900776] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.900920] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.901803] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.901803] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.901803] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.910502] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 in Status: IN_PROGRESS for 2s [ 1092.920332] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.920332] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.920332] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.920449] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.920526] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.931326] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 in Status: IN_PROGRESS for 2s [ 1093.290120] env[65943]: INFO networking_nsxv3.common.synchronization [req-09769f6c-3377-40ba-b4a0-23e41402f17d req-2574ec67-a37a-4abc-922a-3e869255fae6 tempest-ServerActionsTestOtherB-2092325239 tempest-ServerActionsTestOtherB-2092325239-project-member] Enqueued Resource ID: 2880c629-d8d0-45b5-b939-d99c78caab70 with Priority: HIGHEST for action security_group_members [ 1093.290120] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2880c629-d8d0-45b5-b939-d99c78caab70 with Priority: HIGHEST for action security_group_members [ 1093.291833] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2880c629-d8d0-45b5-b939-d99c78caab70 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.292213] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.292376] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.292652] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.292903] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.293124] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.293290] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.293619] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.293800] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.294044] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2880c629-d8d0-45b5-b939-d99c78caab70',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.296165] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a3785ccf-0b13-4a67-ba63-81d28e609f6b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.297591] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3785ccf-0b13-4a67-ba63-81d28e609f6b taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.301225] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3785ccf-0b13-4a67-ba63-81d28e609f6b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.301225] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 554ec2d6-6faa-4555-a9c4-231823a0aafe with status ACTIVE [ 1093.301225] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.301225] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.301225] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.301225] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.301225] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.301225] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.301225] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.301225] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.301225] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.301225] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.301225] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.301225] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.301225] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.301225] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.301225] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.301813] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 554ec2d6-6faa-4555-a9c4-231823a0aafe is going to be updated. [ 1093.325446] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.325628] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.328021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.328021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.328021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.328021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-554ec2d6-6faa-4555-a9c4-231823a0aafe" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.796704] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.796704] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.797192] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.797192] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.797192] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.797332] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.797438] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.797499] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.797691] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.797779] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.797898] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2880c629-d8d0-45b5-b939-d99c78caab70 is going to be updated. [ 1093.799419] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a3785ccf-0b13-4a67-ba63-81d28e609f6b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.833937] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.834045] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.834079] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.834320] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.834582] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.845888] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2880c629-d8d0-45b5-b939-d99c78caab70 in Status: IN_PROGRESS for 2s [ 1094.068179] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-454 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.068179] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-454" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.068179] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-454" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.068179] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-454" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.068179] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.069372] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.069372] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.069372] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.069451] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.069722] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1094.069869] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1094.070009] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1094.070171] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1094.070310] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1094.070474] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1094.070717] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1094.090347] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1094.090517] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1094.090655] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1094.090829] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-454" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.091254] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-2a442713-3297-4f2f-a524-82023980aba2 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.091552] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-2a442713-3297-4f2f-a524-82023980aba2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.091713] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-2a442713-3297-4f2f-a524-82023980aba2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.091889] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-2a442713-3297-4f2f-a524-82023980aba2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.092040] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a442713-3297-4f2f-a524-82023980aba2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.302232] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.302388] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.302457] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.302676] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.302767] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.302864] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3785ccf-0b13-4a67-ba63-81d28e609f6b is going to be created. [ 1094.328959] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.329127] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.329199] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.329408] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.329588] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.340195] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3785ccf-0b13-4a67-ba63-81d28e609f6b in Status: UNINITIALIZED for 2s [ 1094.595635] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.596238] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.596538] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.597270] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.597270] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.597555] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port 2a442713-3297-4f2f-a524-82023980aba2 not found, creating... [ 1094.598039] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.598351] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.598569] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.598950] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.599188] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.599623] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.599856] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.600073] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.600639] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.600930] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.601176] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: 2a442713-3297-4f2f-a524-82023980aba2 is going to be created. [ 1094.628735] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.629198] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.629546] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.630127] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.630628] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.630945] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-2a442713-3297-4f2f-a524-82023980aba2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.922036] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 in Status: SUCCESS [ 1094.922036] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.922036] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.922036] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.922485] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.922485] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.922485] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.922485] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.922485] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.922655] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.922745] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.922889] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.922991] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.923231] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.923455] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.923607] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.923724] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.923964] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.924202] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.924355] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.924506] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.940277] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 in Status: SUCCESS [ 1094.940508] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.941019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.941266] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.941460] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.941613] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.941651] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.941783] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.941866] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.941963] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.942081] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('89dec01a-fac4-47c6-9d76-7e922dba6ec4',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.427548] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 655fa9f8-1f2b-4cc8-b0fa-767189dc0172: rpc.has_security_group_logging(os_id): False [ 1095.430930] env[65943]: INFO networking_nsxv3.common.synchronization [req-09769f6c-3377-40ba-b4a0-23e41402f17d req-9520f937-fb9d-48e1-a1e2-56fea85b8f57 service nova] Enqueued Resource ID: 2880c629-d8d0-45b5-b939-d99c78caab70 with Priority: HIGHEST for action security_group_rules [ 1095.430930] env[65943]: INFO networking_nsxv3.common.synchronization [req-09769f6c-3377-40ba-b4a0-23e41402f17d req-9520f937-fb9d-48e1-a1e2-56fea85b8f57 service nova] Enqueued Resource ID: 2880c629-d8d0-45b5-b939-d99c78caab70 with Priority: HIGHEST for action security_group_members [ 1095.431149] env[65943]: INFO networking_nsxv3.common.synchronization [req-09769f6c-3377-40ba-b4a0-23e41402f17d req-9520f937-fb9d-48e1-a1e2-56fea85b8f57 service nova] Enqueued Resource ID: 2a442713-3297-4f2f-a524-82023980aba2 with Priority: HIGHEST for action port [ 1095.432100] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2880c629-d8d0-45b5-b939-d99c78caab70 with Priority: HIGHEST for action security_group_rules [ 1095.432242] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2880c629-d8d0-45b5-b939-d99c78caab70 with Priority: HIGHEST for action security_group_members [ 1095.437032] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a442713-3297-4f2f-a524-82023980aba2 with Priority: HIGHEST for action port [ 1095.437032] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2880c629-d8d0-45b5-b939-d99c78caab70 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.437032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.437032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.437032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.437032] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2880c629-d8d0-45b5-b939-d99c78caab70',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.437032] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2880c629-d8d0-45b5-b939-d99c78caab70 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.437032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.437335] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a442713-3297-4f2f-a524-82023980aba2 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.437792] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a442713-3297-4f2f-a524-82023980aba2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.437792] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a442713-3297-4f2f-a524-82023980aba2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.437792] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a442713-3297-4f2f-a524-82023980aba2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.437792] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a442713-3297-4f2f-a524-82023980aba2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.444491] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-89dec01a-fac4-47c6-9d76-7e922dba6ec4 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.444601] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.444669] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.444926] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.445452] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.445571] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.445637] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.445803] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.445984] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.445984] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.446142] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-89dec01a-fac4-47c6-9d76-7e922dba6ec4 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.446235] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.446292] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.446439] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.446663] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.446774] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.446863] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.447010] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.447360] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.447360] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.447360] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('89dec01a-fac4-47c6-9d76-7e922dba6ec4',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.453303] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.453303] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.453303] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.453303] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.453303] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.453303] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.453587] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.453587] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.453587] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.453684] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.454087] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.454087] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.454087] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.454258] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.454258] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.454641] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.454641] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.454641] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.454641] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.454867] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.454867] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 is going to be updated. [ 1095.526172] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.526172] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.526172] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.526172] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.526172] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.546824] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 in Status: IN_PROGRESS for 2s [ 1095.858623] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2880c629-d8d0-45b5-b939-d99c78caab70 in Status: SUCCESS [ 1095.858820] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2880c629-d8d0-45b5-b939-d99c78caab70 deletion is rescheduled due to dependency. [ 1095.858983] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.859151] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.859384] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.860032] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.860032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.860032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.860225] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.860225] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.860320] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2880c629-d8d0-45b5-b939-d99c78caab70',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.942073] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2880c629-d8d0-45b5-b939-d99c78caab70 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.942073] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.944071] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2a442713-3297-4f2f-a524-82023980aba2 with status ACTIVE [ 1095.944247] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.944372] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.944442] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.944657] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.944748] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.944924] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.945042] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.945107] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.945259] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.945337] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.945518] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.945610] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.945669] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.945805] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.945881] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.945963] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2a442713-3297-4f2f-a524-82023980aba2 is going to be updated. [ 1095.949594] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 89dec01a-fac4-47c6-9d76-7e922dba6ec4: rpc.has_security_group_logging(os_id): False [ 1095.967810] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.968141] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.968141] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.968408] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.968408] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.968562] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.968664] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.968717] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.968900] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.968981] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.969171] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.969252] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.969317] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.969457] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.969528] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.969728] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.969841] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.969922] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.970083] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.970515] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.970515] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 is going to be updated. [ 1095.974145] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.974282] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.974338] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.974503] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.974642] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.974801] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a442713-3297-4f2f-a524-82023980aba2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.043872] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.044071] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.044117] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.044322] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.044477] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.058488] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 in Status: IN_PROGRESS for 2s [ 1096.352639] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3785ccf-0b13-4a67-ba63-81d28e609f6b in Status: SUCCESS [ 1096.352840] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3785ccf-0b13-4a67-ba63-81d28e609f6b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.353015] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3785ccf-0b13-4a67-ba63-81d28e609f6b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.353232] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3785ccf-0b13-4a67-ba63-81d28e609f6b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.353485] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.353654] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.355023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.355023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.355023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.355023] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3785ccf-0b13-4a67-ba63-81d28e609f6b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.355023] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a3785ccf-0b13-4a67-ba63-81d28e609f6b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.365281] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2880c629-d8d0-45b5-b939-d99c78caab70',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.857743] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a3785ccf-0b13-4a67-ba63-81d28e609f6b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.870204] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2880c629-d8d0-45b5-b939-d99c78caab70',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.360451] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a3785ccf-0b13-4a67-ba63-81d28e609f6b: rpc.has_security_group_logging(os_id): False [ 1097.374767] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.375234] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.375298] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.375539] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.376136] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.376136] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2880c629-d8d0-45b5-b939-d99c78caab70 is going to be updated. [ 1097.381519] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.384090] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.384090] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.384090] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.384090] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.384090] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.384090] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.384090] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.384090] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.384090] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.384090] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3785ccf-0b13-4a67-ba63-81d28e609f6b is going to be created. [ 1097.411826] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.412908] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.413066] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.413336] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.414079] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.427394] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2880c629-d8d0-45b5-b939-d99c78caab70 in Status: IN_PROGRESS for 2s [ 1097.467367] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.467586] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.467679] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.467915] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.468199] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.483614] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3785ccf-0b13-4a67-ba63-81d28e609f6b in Status: IN_PROGRESS for 2s [ 1097.566222] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 in Status: SUCCESS [ 1097.566934] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.566934] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.566934] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.566934] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.071826] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.071826] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.071826] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.071826] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.072083] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.072083] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.072151] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.072294] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.072368] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.072449] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.072568] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.075541] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 in Status: SUCCESS [ 1098.075837] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.575713] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.576109] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.576109] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.576423] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.576668] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.576842] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.576955] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.577176] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.577313] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.577441] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.577657] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.577787] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.577871] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.578046] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.578268] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.578425] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.578529] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.578729] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.578849] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.578978] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.579132] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.083480] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 655fa9f8-1f2b-4cc8-b0fa-767189dc0172: rpc.has_security_group_logging(os_id): False [ 1099.101572] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.101789] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.101882] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.102130] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.102211] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.102433] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.102551] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.102632] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.102831] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.102950] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.103239] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.103371] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.103464] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.103664] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.103748] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.103965] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.104090] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.104179] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.104375] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.104467] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.104559] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 is going to be updated. [ 1099.136822] env[65943]: INFO networking_nsxv3.common.synchronization [req-dc02c6cc-951a-49ca-980f-f868e6fe9d9d req-9fd0ead0-d885-4b54-a4d0-98a7227bf4c2 tempest-ServersTestMultiNic-1452946458 tempest-ServersTestMultiNic-1452946458-project-member] Enqueued Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_members [ 1099.137480] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_members [ 1099.137803] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.138084] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.138084] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.138228] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.138391] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.138508] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.138550] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.138680] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.138785] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.138945] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.178788] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.178969] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.179051] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.179264] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.179416] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.198651] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 in Status: IN_PROGRESS for 2s [ 1099.378863] env[65943]: INFO networking_nsxv3.common.synchronization [req-dc02c6cc-951a-49ca-980f-f868e6fe9d9d req-97d644f1-d84f-442a-97f4-28cfb0ad34fb tempest-ServersTestMultiNic-1452946458 tempest-ServersTestMultiNic-1452946458-project-member] Enqueued Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_members [ 1099.379504] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 with Priority: HIGHEST for action security_group_members [ 1099.380124] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.380220] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.439636] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2880c629-d8d0-45b5-b939-d99c78caab70 in Status: SUCCESS [ 1099.439853] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.440205] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.440571] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.441032] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.441222] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.441370] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.441773] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.441928] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.442222] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.442415] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2880c629-d8d0-45b5-b939-d99c78caab70',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.497741] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3785ccf-0b13-4a67-ba63-81d28e609f6b in Status: SUCCESS [ 1099.498071] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3785ccf-0b13-4a67-ba63-81d28e609f6b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.641538] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.945150] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2880c629-d8d0-45b5-b939-d99c78caab70',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.086925] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-916 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.087257] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-916" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.087398] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-916" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.087701] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-916" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.088066] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.088248] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.088323] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.088558] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.088703] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.088979] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1100.089120] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1100.089220] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1100.089327] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1100.089438] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1100.089555] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1100.089683] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1100.113062] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1100.113256] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1100.113614] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1100.113682] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-916" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.114112] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-bd45e6b4-5e04-4f01-a2d3-3f64a56215f7 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.114358] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-bd45e6b4-5e04-4f01-a2d3-3f64a56215f7" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.114533] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-bd45e6b4-5e04-4f01-a2d3-3f64a56215f7" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.114889] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-bd45e6b4-5e04-4f01-a2d3-3f64a56215f7" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.115037] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd45e6b4-5e04-4f01-a2d3-3f64a56215f7',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.144296] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.448220] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2880c629-d8d0-45b5-b939-d99c78caab70: rpc.has_security_group_logging(os_id): False [ 1100.472087] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.472087] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.472087] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.472087] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.472087] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.472087] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.472087] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.472087] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.472087] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.472087] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.472087] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2880c629-d8d0-45b5-b939-d99c78caab70 is going to be updated. [ 1100.542720] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.542967] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.542967] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.543299] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.543299] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.552554] env[65943]: INFO networking_nsxv3.common.synchronization [req-37232388-351f-46ef-881f-6b1e90d1bff4 req-16856da2-81bc-47ab-aea8-d12120938d30 tempest-ServerActionsTestOtherA-92071881 tempest-ServerActionsTestOtherA-92071881-project-member] Enqueued Resource ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 with Priority: HIGHEST for action security_group_members [ 1100.553135] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 with Priority: HIGHEST for action security_group_members [ 1100.553405] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-89dec01a-fac4-47c6-9d76-7e922dba6ec4 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.553654] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.553654] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.554045] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.554045] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.554045] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.554045] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.554358] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.554358] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.554358] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89dec01a-fac4-47c6-9d76-7e922dba6ec4',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.557362] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2880c629-d8d0-45b5-b939-d99c78caab70 in Status: IN_PROGRESS for 2s [ 1100.608389] env[65943]: INFO networking_nsxv3.common.synchronization [req-37232388-351f-46ef-881f-6b1e90d1bff4 req-16856da2-81bc-47ab-aea8-d12120938d30 tempest-ServerActionsTestOtherA-92071881 tempest-ServerActionsTestOtherA-92071881-project-member] Enqueued Resource ID: 80f66b6d-d2b5-4012-9253-43d5e77fb97a with Priority: HIGHEST for action port [ 1100.609252] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80f66b6d-d2b5-4012-9253-43d5e77fb97a with Priority: HIGHEST for action port [ 1100.609622] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-80f66b6d-d2b5-4012-9253-43d5e77fb97a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.609746] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-80f66b6d-d2b5-4012-9253-43d5e77fb97a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.609943] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-80f66b6d-d2b5-4012-9253-43d5e77fb97a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.610220] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-80f66b6d-d2b5-4012-9253-43d5e77fb97a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.610326] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80f66b6d-d2b5-4012-9253-43d5e77fb97a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.617701] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.617970] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.618112] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.618397] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.618593] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.618906] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.619100] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.619224] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.619475] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.619619] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.619956] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.620169] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.620288] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.620509] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.620671] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.620818] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: bd45e6b4-5e04-4f01-a2d3-3f64a56215f7 is going to be updated. [ 1100.646941] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.647246] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.647246] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.647429] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.647520] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.647621] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 is going to be updated. [ 1100.661217] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.661426] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.661566] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.661847] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.662057] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.662313] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-bd45e6b4-5e04-4f01-a2d3-3f64a56215f7" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.681818] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.681913] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.681989] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.682229] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.682358] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.692166] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 in Status: IN_PROGRESS for 2s [ 1101.059135] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.059250] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.059250] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.059460] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.059586] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.059809] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.060031] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.060124] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.060359] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.060452] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.060548] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 is going to be updated. [ 1101.088797] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.089113] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.089261] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.089615] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.089825] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.102112] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 in Status: IN_PROGRESS for 2s [ 1101.113062] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 80f66b6d-d2b5-4012-9253-43d5e77fb97a with status ACTIVE [ 1101.113184] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.113361] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.113442] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.113775] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.113934] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.114219] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.114348] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.114765] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.115065] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.115192] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.115500] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.115677] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.115779] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.116039] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.116139] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.116268] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 80f66b6d-d2b5-4012-9253-43d5e77fb97a is going to be updated. [ 1101.143100] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.143289] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.143386] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.143708] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.143880] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.144128] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-80f66b6d-d2b5-4012-9253-43d5e77fb97a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.221940] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 in Status: SUCCESS [ 1101.222218] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.372280] env[65943]: INFO networking_nsxv3.common.synchronization [req-6c465161-35d4-43f3-9c53-9310fa536f5d req-757203ff-6025-417b-ace7-4c7cd840ada4 service nova] Enqueued Resource ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 with Priority: HIGHEST for action security_group_rules [ 1101.372498] env[65943]: INFO networking_nsxv3.common.synchronization [req-6c465161-35d4-43f3-9c53-9310fa536f5d req-757203ff-6025-417b-ace7-4c7cd840ada4 service nova] Enqueued Resource ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 with Priority: HIGHEST for action security_group_members [ 1101.372654] env[65943]: INFO networking_nsxv3.common.synchronization [req-6c465161-35d4-43f3-9c53-9310fa536f5d req-757203ff-6025-417b-ace7-4c7cd840ada4 service nova] Enqueued Resource ID: bd45e6b4-5e04-4f01-a2d3-3f64a56215f7 with Priority: HIGHEST for action port [ 1101.373453] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 with Priority: HIGHEST for action security_group_rules [ 1101.373544] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 with Priority: HIGHEST for action security_group_members [ 1101.373650] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd45e6b4-5e04-4f01-a2d3-3f64a56215f7 with Priority: HIGHEST for action port [ 1101.373936] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c8a054b-6bee-465e-84da-d50dfdc27f64 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.374069] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.374151] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.374350] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.374429] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.375350] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8a054b-6bee-465e-84da-d50dfdc27f64 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.380641] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.380641] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.380641] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.380641] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.380641] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.380641] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.380641] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.380641] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.380641] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.380641] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd45e6b4-5e04-4f01-a2d3-3f64a56215f7 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.380641] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd45e6b4-5e04-4f01-a2d3-3f64a56215f7" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.380641] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd45e6b4-5e04-4f01-a2d3-3f64a56215f7" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.380641] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd45e6b4-5e04-4f01-a2d3-3f64a56215f7" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.380641] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd45e6b4-5e04-4f01-a2d3-3f64a56215f7',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.579875] env[65943]: INFO networking_nsxv3.common.synchronization [req-80dbf048-a4d3-4762-a6c8-6e9ededcb64a req-dcbc03e3-9477-45d8-8978-688b87e31346 tempest-DeleteServersTestJSON-1404918926 tempest-DeleteServersTestJSON-1404918926-project-member] Enqueued Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_members [ 1101.580890] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_members [ 1101.581098] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.581227] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.581298] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.581519] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.581694] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.581770] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.581827] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.581979] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.582088] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.582204] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.881529] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.883354] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8a054b-6bee-465e-84da-d50dfdc27f64 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.883473] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.883889] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bd45e6b4-5e04-4f01-a2d3-3f64a56215f7 with status ACTIVE [ 1101.884098] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.884273] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.884396] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.884711] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.884872] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.886061] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.886480] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.886480] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.886587] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.886683] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.886889] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.886993] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.887076] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.887274] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.887344] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.887436] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bd45e6b4-5e04-4f01-a2d3-3f64a56215f7 is going to be updated. [ 1101.912124] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.912312] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.912358] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.912644] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.912709] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.912870] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd45e6b4-5e04-4f01-a2d3-3f64a56215f7" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.082360] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-749 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.082545] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-749" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.082666] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-749" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.083068] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-749" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.083351] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.083514] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.083631] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.083849] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.084274] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.084525] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1102.084639] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1102.084744] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1102.084852] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1102.084962] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1102.085089] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1102.085223] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1102.087134] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.087266] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.087341] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.087506] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.087595] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.087774] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.087985] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.087985] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.088117] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.088152] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.088232] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 is going to be updated. [ 1102.112578] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1102.112779] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1102.112902] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1102.113095] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-749" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.113428] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-8f34da43-1eed-4362-bba5-b3ca4a008d63 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.113614] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-8f34da43-1eed-4362-bba5-b3ca4a008d63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.113815] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-8f34da43-1eed-4362-bba5-b3ca4a008d63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.114191] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-8f34da43-1eed-4362-bba5-b3ca4a008d63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.114363] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f34da43-1eed-4362-bba5-b3ca4a008d63',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.119705] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.120095] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.120186] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.120379] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.121204] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.131963] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: IN_PROGRESS for 2s [ 1102.384912] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.574078] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2880c629-d8d0-45b5-b939-d99c78caab70 in Status: SUCCESS [ 1102.574387] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.617618] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.618404] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.618550] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.618962] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.619170] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.619359] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port 8f34da43-1eed-4362-bba5-b3ca4a008d63 not found, creating... [ 1102.621495] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.621495] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.621495] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.621495] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.621495] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.621495] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.621495] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.621495] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.621495] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.621495] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.622245] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: 8f34da43-1eed-4362-bba5-b3ca4a008d63 is going to be created. [ 1102.643894] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.644217] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.644366] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.644654] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.644896] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.645563] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-8f34da43-1eed-4362-bba5-b3ca4a008d63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.722763] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 in Status: SUCCESS [ 1102.722994] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.723181] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.723401] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.723750] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.723750] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.723750] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.723927] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.723995] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.724512] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('655fa9f8-1f2b-4cc8-b0fa-767189dc0172',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.760219] env[65943]: INFO networking_nsxv3.common.synchronization [None req-1b890ead-ec39-4574-b0d8-d578dabb1d90 None None] Enqueued Resource ID: 278c5b5b-4651-49a8-8dbc-fa8d8f79c910 with Priority: HIGHEST for action port [ 1102.760825] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 278c5b5b-4651-49a8-8dbc-fa8d8f79c910 with Priority: HIGHEST for action port [ 1102.761187] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-278c5b5b-4651-49a8-8dbc-fa8d8f79c910 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.761593] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-278c5b5b-4651-49a8-8dbc-fa8d8f79c910" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.761593] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-278c5b5b-4651-49a8-8dbc-fa8d8f79c910" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.761700] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-278c5b5b-4651-49a8-8dbc-fa8d8f79c910" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.761700] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('278c5b5b-4651-49a8-8dbc-fa8d8f79c910',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.889478] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.889891] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.889891] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.889991] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.890106] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.890217] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 is going to be updated. [ 1102.931039] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.931257] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.931298] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.931566] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.931719] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.940698] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 in Status: IN_PROGRESS for 2s [ 1103.111651] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 in Status: SUCCESS [ 1103.111820] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89dec01a-fac4-47c6-9d76-7e922dba6ec4 deletion is rescheduled due to dependency. [ 1103.111934] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89dec01a-fac4-47c6-9d76-7e922dba6ec4" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.226463] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.227760] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.227760] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.227760] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.228090] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.228474] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.229268] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.229268] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.229268] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.229268] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.229268] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 is going to be updated. [ 1103.256826] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.257063] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.257157] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.257351] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.257492] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.268146] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 278c5b5b-4651-49a8-8dbc-fa8d8f79c910 [ 1103.268392] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.268523] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.268605] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.268810] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.268945] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.269055] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:278c5b5b-4651-49a8-8dbc-fa8d8f79c910 already deleted. [ 1103.269166] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-278c5b5b-4651-49a8-8dbc-fa8d8f79c910" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.270108] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 in Status: IN_PROGRESS for 2s [ 1103.823063] env[65943]: INFO networking_nsxv3.common.synchronization [req-80dbf048-a4d3-4762-a6c8-6e9ededcb64a req-ade80eb8-ed1c-4bc9-9c7f-b793719de295 service nova] Enqueued Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_rules [ 1103.823288] env[65943]: INFO networking_nsxv3.common.synchronization [req-80dbf048-a4d3-4762-a6c8-6e9ededcb64a req-ade80eb8-ed1c-4bc9-9c7f-b793719de295 service nova] Enqueued Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_members [ 1103.823521] env[65943]: INFO networking_nsxv3.common.synchronization [req-80dbf048-a4d3-4762-a6c8-6e9ededcb64a req-ade80eb8-ed1c-4bc9-9c7f-b793719de295 service nova] Enqueued Resource ID: 8f34da43-1eed-4362-bba5-b3ca4a008d63 with Priority: HIGHEST for action port [ 1103.824636] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_rules [ 1103.824716] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_members [ 1103.824848] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f34da43-1eed-4362-bba5-b3ca4a008d63 with Priority: HIGHEST for action port [ 1103.827449] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.827449] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.827449] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.827449] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.827449] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.827449] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.827449] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.827813] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f34da43-1eed-4362-bba5-b3ca4a008d63 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.827813] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f34da43-1eed-4362-bba5-b3ca4a008d63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.827928] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f34da43-1eed-4362-bba5-b3ca4a008d63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.828090] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f34da43-1eed-4362-bba5-b3ca4a008d63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.828184] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f34da43-1eed-4362-bba5-b3ca4a008d63',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.150420] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: SUCCESS [ 1104.150856] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 deletion is rescheduled due to dependency. [ 1104.150856] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.150856] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.151114] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.151288] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.151401] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.151465] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.151621] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.151702] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.151799] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.330615] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.331022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.332202] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8f34da43-1eed-4362-bba5-b3ca4a008d63 with status ACTIVE [ 1104.332480] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.332643] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.332737] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.333012] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.333136] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.333337] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.333465] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.333545] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.333739] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.333840] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.334090] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.334232] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.334324] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.334509] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.334594] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.334703] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8f34da43-1eed-4362-bba5-b3ca4a008d63 is going to be updated. [ 1104.357526] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.357713] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.357765] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.358032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.358278] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.358357] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f34da43-1eed-4362-bba5-b3ca4a008d63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.655247] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.952329] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 in Status: SUCCESS [ 1104.952564] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.952736] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.952964] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.953183] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.953303] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.953369] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.953524] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.953632] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.953689] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.954494] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.160039] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.287805] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 in Status: SUCCESS [ 1105.287968] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 655fa9f8-1f2b-4cc8-b0fa-767189dc0172 deletion is rescheduled due to dependency. [ 1105.288933] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655fa9f8-1f2b-4cc8-b0fa-767189dc0172" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.456706] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8a054b-6bee-465e-84da-d50dfdc27f64 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.456706] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.456706] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.457099] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.457360] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.457360] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.457360] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.457671] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.457671] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.457671] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.457877] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8a054b-6bee-465e-84da-d50dfdc27f64 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.457877] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.457961] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.458079] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.458208] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.458304] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.458353] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.458490] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.458600] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.458681] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.458733] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.664477] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.664477] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.664477] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.664901] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.667099] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.667099] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 is going to be updated. [ 1105.699601] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.699757] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.699891] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.700567] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.700567] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.713110] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: IN_PROGRESS for 2s [ 1105.915853] env[65943]: INFO networking_nsxv3.common.synchronization [None req-a810590b-d04f-441d-a065-16817f80fb29 None None] Enqueued Resource ID: b808f0ca-0410-4aa7-8533-5b338c2b4b78 with Priority: HIGHEST for action port [ 1105.916741] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b808f0ca-0410-4aa7-8533-5b338c2b4b78 with Priority: HIGHEST for action port [ 1105.917088] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-b808f0ca-0410-4aa7-8533-5b338c2b4b78 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.917216] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b808f0ca-0410-4aa7-8533-5b338c2b4b78" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.917527] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b808f0ca-0410-4aa7-8533-5b338c2b4b78" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.917702] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b808f0ca-0410-4aa7-8533-5b338c2b4b78" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.917745] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b808f0ca-0410-4aa7-8533-5b338c2b4b78',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.963951] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c8a054b-6bee-465e-84da-d50dfdc27f64: rpc.has_security_group_logging(os_id): False [ 1105.987375] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.987375] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.987375] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.987375] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.987375] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.987375] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.987375] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.987375] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.987375] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.987375] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.987375] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.987375] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.987375] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.988373] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.988373] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.988373] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.988373] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.988373] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.988622] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.988622] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.988622] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 is going to be updated. [ 1106.064322] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.064434] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.064508] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.064740] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.064856] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.081402] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 in Status: IN_PROGRESS for 2s [ 1106.420666] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b808f0ca-0410-4aa7-8533-5b338c2b4b78 [ 1106.420974] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.421145] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.421225] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.421537] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.421605] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.421689] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b808f0ca-0410-4aa7-8533-5b338c2b4b78 already deleted. [ 1106.421789] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b808f0ca-0410-4aa7-8533-5b338c2b4b78" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.727083] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: SUCCESS [ 1107.727363] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.727510] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.727773] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.728514] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.728514] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.728514] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.728514] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.728514] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.728514] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.728514] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.096302] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 in Status: SUCCESS [ 1108.096302] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.233066] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.233274] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.233348] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.233548] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.233718] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.233853] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.233904] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.234047] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.234152] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.234265] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.234403] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.235093] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.235093] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.235093] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.235093] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.235093] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.235442] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.235442] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.235442] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.235722] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.235722] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.738324] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15454ceb-9062-41fb-908b-b5ae144dbe65: rpc.has_security_group_logging(os_id): False [ 1108.755889] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.756062] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.756104] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.756324] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.756418] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.756762] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.756956] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.757057] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.757159] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.757238] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.757441] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.757535] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.757633] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.757767] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.757844] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.758374] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.758374] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.758374] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.758374] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.758374] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.758561] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 is going to be updated. [ 1108.827981] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.828158] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.828251] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.828610] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.828703] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.846602] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: IN_PROGRESS for 2s [ 1110.036516] env[65943]: INFO networking_nsxv3.common.synchronization [req-f18f42da-5918-4d87-979d-93c146167d27 req-b51a1efb-33c5-408a-8c52-0a0585915c60 tempest-ServerPasswordTestJSON-1673678623 tempest-ServerPasswordTestJSON-1673678623-project-member] Enqueued Resource ID: b3cf4dd4-6ece-41ef-bd05-4a81131c66c6 with Priority: HIGHEST for action security_group_members [ 1110.037940] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3cf4dd4-6ece-41ef-bd05-4a81131c66c6 with Priority: HIGHEST for action security_group_members [ 1110.038427] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3cf4dd4-6ece-41ef-bd05-4a81131c66c6 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.038668] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3cf4dd4-6ece-41ef-bd05-4a81131c66c6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.038821] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3cf4dd4-6ece-41ef-bd05-4a81131c66c6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.039666] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3cf4dd4-6ece-41ef-bd05-4a81131c66c6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.039666] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.039820] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.039820] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.040089] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.040222] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.040342] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3cf4dd4-6ece-41ef-bd05-4a81131c66c6',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.454312] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-683 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.454593] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-683" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.454758] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-683" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.455239] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-683" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.455556] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.455789] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.456676] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.456676] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.456676] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.456956] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1110.457105] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1110.457168] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1110.457333] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1110.457557] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1110.457700] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1110.457852] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1110.478353] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1110.478553] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1110.478671] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1110.478845] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-683" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.479425] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-14500f5f-67f2-4036-9836-ac0801e88d6a taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.479645] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-14500f5f-67f2-4036-9836-ac0801e88d6a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.479777] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-14500f5f-67f2-4036-9836-ac0801e88d6a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.480220] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-14500f5f-67f2-4036-9836-ac0801e88d6a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.480362] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14500f5f-67f2-4036-9836-ac0801e88d6a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.543129] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.543339] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.543390] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.543574] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.544217] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.544217] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.544217] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.544217] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.544217] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.544500] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.544500] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3cf4dd4-6ece-41ef-bd05-4a81131c66c6 already deleted. [ 1110.544500] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3cf4dd4-6ece-41ef-bd05-4a81131c66c6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.635549] env[65943]: INFO networking_nsxv3.common.synchronization [None req-adc21544-5e4c-49cf-a01f-b4cf25be30d8 None None] Enqueued Resource ID: f342c08c-5a2d-42c2-b088-e83caa6b74ea with Priority: HIGHEST for action port [ 1110.636087] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f342c08c-5a2d-42c2-b088-e83caa6b74ea with Priority: HIGHEST for action port [ 1110.636394] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-f342c08c-5a2d-42c2-b088-e83caa6b74ea taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.636513] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f342c08c-5a2d-42c2-b088-e83caa6b74ea" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.636580] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f342c08c-5a2d-42c2-b088-e83caa6b74ea" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.636857] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f342c08c-5a2d-42c2-b088-e83caa6b74ea" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.636940] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f342c08c-5a2d-42c2-b088-e83caa6b74ea',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.865581] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: SUCCESS [ 1110.865829] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.986261] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.986718] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.986718] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.986909] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.987069] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.987227] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port 14500f5f-67f2-4036-9836-ac0801e88d6a not found, creating... [ 1110.987498] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.987656] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.987773] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.987995] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.988147] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.988428] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.988850] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.988850] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.988974] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.989623] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.989623] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: 14500f5f-67f2-4036-9836-ac0801e88d6a is going to be created. [ 1111.011839] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.011839] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.011839] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.011839] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.011839] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.011839] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-14500f5f-67f2-4036-9836-ac0801e88d6a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.143258] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f342c08c-5a2d-42c2-b088-e83caa6b74ea [ 1111.143258] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.143258] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.143258] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.143258] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.143258] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.143258] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f342c08c-5a2d-42c2-b088-e83caa6b74ea already deleted. [ 1111.143258] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f342c08c-5a2d-42c2-b088-e83caa6b74ea" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.259643] env[65943]: INFO networking_nsxv3.common.synchronization [req-f18f42da-5918-4d87-979d-93c146167d27 req-0985fb03-8c46-4545-9d32-aed700f8bd31 service nova] Enqueued Resource ID: b3cf4dd4-6ece-41ef-bd05-4a81131c66c6 with Priority: HIGHEST for action security_group_rules [ 1112.259643] env[65943]: INFO networking_nsxv3.common.synchronization [req-f18f42da-5918-4d87-979d-93c146167d27 req-0985fb03-8c46-4545-9d32-aed700f8bd31 service nova] Enqueued Resource ID: b3cf4dd4-6ece-41ef-bd05-4a81131c66c6 with Priority: HIGHEST for action security_group_members [ 1112.259643] env[65943]: INFO networking_nsxv3.common.synchronization [req-f18f42da-5918-4d87-979d-93c146167d27 req-0985fb03-8c46-4545-9d32-aed700f8bd31 service nova] Enqueued Resource ID: 14500f5f-67f2-4036-9836-ac0801e88d6a with Priority: HIGHEST for action port [ 1112.259643] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3cf4dd4-6ece-41ef-bd05-4a81131c66c6 with Priority: HIGHEST for action security_group_rules [ 1112.259643] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3cf4dd4-6ece-41ef-bd05-4a81131c66c6 with Priority: HIGHEST for action security_group_members [ 1112.259643] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14500f5f-67f2-4036-9836-ac0801e88d6a with Priority: HIGHEST for action port [ 1112.259643] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b3cf4dd4-6ece-41ef-bd05-4a81131c66c6 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.259643] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b3cf4dd4-6ece-41ef-bd05-4a81131c66c6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.259643] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b3cf4dd4-6ece-41ef-bd05-4a81131c66c6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.260246] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b3cf4dd4-6ece-41ef-bd05-4a81131c66c6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.261288] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b3cf4dd4-6ece-41ef-bd05-4a81131c66c6',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.262093] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3cf4dd4-6ece-41ef-bd05-4a81131c66c6 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.262232] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3cf4dd4-6ece-41ef-bd05-4a81131c66c6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.262355] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3cf4dd4-6ece-41ef-bd05-4a81131c66c6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.262492] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3cf4dd4-6ece-41ef-bd05-4a81131c66c6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.262763] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.262763] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.262846] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.262932] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.263097] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.264038] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3cf4dd4-6ece-41ef-bd05-4a81131c66c6',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.264579] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-14500f5f-67f2-4036-9836-ac0801e88d6a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.264579] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14500f5f-67f2-4036-9836-ac0801e88d6a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.264579] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14500f5f-67f2-4036-9836-ac0801e88d6a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.264745] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14500f5f-67f2-4036-9836-ac0801e88d6a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.264862] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14500f5f-67f2-4036-9836-ac0801e88d6a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.766686] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3cf4dd4-6ece-41ef-bd05-4a81131c66c6 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.766814] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3cf4dd4-6ece-41ef-bd05-4a81131c66c6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.766940] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b3cf4dd4-6ece-41ef-bd05-4a81131c66c6',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.768037] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 14500f5f-67f2-4036-9836-ac0801e88d6a with status ACTIVE [ 1112.768120] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.768178] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.768276] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.768469] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.768555] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.768723] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.768818] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.768886] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.769081] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.769184] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.769346] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.769455] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.769508] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.769625] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.769697] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.769776] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 14500f5f-67f2-4036-9836-ac0801e88d6a is going to be updated. [ 1112.793468] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.794721] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.794721] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.794721] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.794721] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.794721] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14500f5f-67f2-4036-9836-ac0801e88d6a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.985847] env[65943]: INFO networking_nsxv3.common.synchronization [None req-20f3d65e-1361-4108-a444-642e6a6de57e None None] Enqueued Resource ID: 1399a568-c84e-4769-abc8-b0fce08f8b54 with Priority: HIGHEST for action port [ 1112.986352] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1399a568-c84e-4769-abc8-b0fce08f8b54 with Priority: HIGHEST for action port [ 1112.986665] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-1399a568-c84e-4769-abc8-b0fce08f8b54 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.986793] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1399a568-c84e-4769-abc8-b0fce08f8b54" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.986863] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1399a568-c84e-4769-abc8-b0fce08f8b54" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.987186] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1399a568-c84e-4769-abc8-b0fce08f8b54" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.987308] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1399a568-c84e-4769-abc8-b0fce08f8b54',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.273609] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b3cf4dd4-6ece-41ef-bd05-4a81131c66c6',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.489814] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1399a568-c84e-4769-abc8-b0fce08f8b54 [ 1113.490034] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.490299] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.490299] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.490515] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.490658] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.490777] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1399a568-c84e-4769-abc8-b0fce08f8b54 already deleted. [ 1113.490884] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1399a568-c84e-4769-abc8-b0fce08f8b54" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.776031] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.776196] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.776196] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.776328] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.776425] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.776522] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3cf4dd4-6ece-41ef-bd05-4a81131c66c6 is going to be created. [ 1113.801880] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.802077] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.802077] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.802287] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.802453] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.811778] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3cf4dd4-6ece-41ef-bd05-4a81131c66c6 in Status: UNINITIALIZED for 2s [ 1115.822918] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3cf4dd4-6ece-41ef-bd05-4a81131c66c6 in Status: SUCCESS [ 1115.823347] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3cf4dd4-6ece-41ef-bd05-4a81131c66c6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.823395] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3cf4dd4-6ece-41ef-bd05-4a81131c66c6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.823601] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3cf4dd4-6ece-41ef-bd05-4a81131c66c6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.823792] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.823903] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.823967] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.824132] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.824212] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.824296] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3cf4dd4-6ece-41ef-bd05-4a81131c66c6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.824384] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b3cf4dd4-6ece-41ef-bd05-4a81131c66c6',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.327277] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3cf4dd4-6ece-41ef-bd05-4a81131c66c6 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.327277] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3cf4dd4-6ece-41ef-bd05-4a81131c66c6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.327526] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3cf4dd4-6ece-41ef-bd05-4a81131c66c6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.327526] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3cf4dd4-6ece-41ef-bd05-4a81131c66c6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.327694] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.327795] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.327848] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.328129] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.328129] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.328225] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3cf4dd4-6ece-41ef-bd05-4a81131c66c6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.328357] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3cf4dd4-6ece-41ef-bd05-4a81131c66c6 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.328489] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3cf4dd4-6ece-41ef-bd05-4a81131c66c6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.328489] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3cf4dd4-6ece-41ef-bd05-4a81131c66c6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.328861] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3cf4dd4-6ece-41ef-bd05-4a81131c66c6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.328861] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.328861] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.328861] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.329125] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.329125] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.329232] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3cf4dd4-6ece-41ef-bd05-4a81131c66c6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.329232] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b3cf4dd4-6ece-41ef-bd05-4a81131c66c6',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.774271] env[65943]: INFO networking_nsxv3.common.synchronization [req-6a766017-92e0-4b94-a4af-6d49ed5bb9e0 req-9644b584-9521-408b-a64a-daab5ad62867 tempest-ServerRescueTestJSON-1872144016 tempest-ServerRescueTestJSON-1872144016-project-member] Enqueued Resource ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 with Priority: HIGHEST for action security_group_members [ 1116.774841] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 with Priority: HIGHEST for action security_group_members [ 1116.775195] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a24c880-984b-4cdd-bb2c-6117349d9d43 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.775539] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.775539] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.775671] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.775832] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.775930] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.775994] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.776167] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.776252] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.776345] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a24c880-984b-4cdd-bb2c-6117349d9d43',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.834342] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b3cf4dd4-6ece-41ef-bd05-4a81131c66c6: rpc.has_security_group_logging(os_id): False [ 1116.857119] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.857332] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.857332] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.857604] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.857712] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.857938] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.858054] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.858119] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.858278] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.858373] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.858599] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.858713] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.858787] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.859028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.859100] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.859272] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.859366] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.859443] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.859641] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.859730] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.859817] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b3cf4dd4-6ece-41ef-bd05-4a81131c66c6 is going to be created. [ 1116.922764] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.922977] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.922977] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.923202] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.923386] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.938602] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b3cf4dd4-6ece-41ef-bd05-4a81131c66c6 in Status: IN_PROGRESS for 2s [ 1117.097518] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-874 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.097716] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-874" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.097839] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-874" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.098203] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-874" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.098476] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.098635] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.098748] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.099009] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.099210] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.099462] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1117.099578] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1117.099685] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1117.099792] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1117.099898] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1117.100032] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1117.100144] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1117.121007] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1117.121237] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1117.121404] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1117.121623] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-874" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.121978] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-3ab5f375-1621-4ef7-a083-344250c994bb taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.122179] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-3ab5f375-1621-4ef7-a083-344250c994bb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.122299] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-3ab5f375-1621-4ef7-a083-344250c994bb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.122634] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-3ab5f375-1621-4ef7-a083-344250c994bb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.122812] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ab5f375-1621-4ef7-a083-344250c994bb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.278916] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.279191] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.279237] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.279492] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.279582] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.279804] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.279917] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.279994] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.280165] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.280241] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.280331] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 already deleted. [ 1117.280399] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.628025] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.628025] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.628025] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.628025] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.628025] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.628025] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port 3ab5f375-1621-4ef7-a083-344250c994bb not found, creating... [ 1117.628025] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.628025] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.628025] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.628025] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.628025] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.629191] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.629616] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.629896] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.631128] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.631128] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.631128] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: 3ab5f375-1621-4ef7-a083-344250c994bb is going to be created. [ 1117.655096] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.655464] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.655646] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.656083] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.656455] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.656864] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-3ab5f375-1621-4ef7-a083-344250c994bb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.197973] env[65943]: INFO networking_nsxv3.common.synchronization [req-3f86ca5b-fbb8-48d2-8720-87f002ce3b4e req-fa2ab63b-c367-445b-9632-1d974e91f541 tempest-DeleteServersTestJSON-1404918926 tempest-DeleteServersTestJSON-1404918926-project-member] Enqueued Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_members [ 1118.198536] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_members [ 1118.198833] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.199021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.199394] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.200041] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.200041] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.200041] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.200041] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.200373] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.200373] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.200373] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.362159] env[65943]: INFO networking_nsxv3.common.synchronization [req-6a766017-92e0-4b94-a4af-6d49ed5bb9e0 req-c2e137ee-2a59-4740-997c-380f07b05783 service nova] Enqueued Resource ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 with Priority: HIGHEST for action security_group_rules [ 1118.362372] env[65943]: INFO networking_nsxv3.common.synchronization [req-6a766017-92e0-4b94-a4af-6d49ed5bb9e0 req-c2e137ee-2a59-4740-997c-380f07b05783 service nova] Enqueued Resource ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 with Priority: HIGHEST for action security_group_members [ 1118.362513] env[65943]: INFO networking_nsxv3.common.synchronization [req-6a766017-92e0-4b94-a4af-6d49ed5bb9e0 req-c2e137ee-2a59-4740-997c-380f07b05783 service nova] Enqueued Resource ID: 3ab5f375-1621-4ef7-a083-344250c994bb with Priority: HIGHEST for action port [ 1118.363176] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 with Priority: HIGHEST for action security_group_rules [ 1118.363276] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 with Priority: HIGHEST for action security_group_members [ 1118.363372] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ab5f375-1621-4ef7-a083-344250c994bb with Priority: HIGHEST for action port [ 1118.363639] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a24c880-984b-4cdd-bb2c-6117349d9d43 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.363761] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.363826] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.364698] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.364838] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a24c880-984b-4cdd-bb2c-6117349d9d43',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.366387] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a24c880-984b-4cdd-bb2c-6117349d9d43 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.366539] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.366603] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.366773] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.367029] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.367166] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.367246] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.367395] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.367696] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.367696] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a24c880-984b-4cdd-bb2c-6117349d9d43',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.371432] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ab5f375-1621-4ef7-a083-344250c994bb taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.371432] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ab5f375-1621-4ef7-a083-344250c994bb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.371432] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ab5f375-1621-4ef7-a083-344250c994bb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.371432] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ab5f375-1621-4ef7-a083-344250c994bb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.371432] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ab5f375-1621-4ef7-a083-344250c994bb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.702500] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.702701] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.702701] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.702950] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.703059] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.703262] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.703362] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.703423] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.703574] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.703649] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.703733] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 is going to be updated. [ 1118.734726] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.734920] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.734920] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.735215] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.735369] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.745095] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: IN_PROGRESS for 2s [ 1118.867418] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a24c880-984b-4cdd-bb2c-6117349d9d43 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.867599] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.870137] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a24c880-984b-4cdd-bb2c-6117349d9d43',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.873521] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3ab5f375-1621-4ef7-a083-344250c994bb with status ACTIVE [ 1118.873521] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.873521] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.873521] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.873521] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.873521] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.873521] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.873521] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.873521] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.873521] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.873521] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.873980] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.873980] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.873980] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.873980] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.874122] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.874150] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3ab5f375-1621-4ef7-a083-344250c994bb is going to be updated. [ 1118.896036] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.896036] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.896284] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.896368] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.896510] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.896672] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ab5f375-1621-4ef7-a083-344250c994bb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.959164] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b3cf4dd4-6ece-41ef-bd05-4a81131c66c6 in Status: SUCCESS [ 1118.959429] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b3cf4dd4-6ece-41ef-bd05-4a81131c66c6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.374127] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a24c880-984b-4cdd-bb2c-6117349d9d43',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.503022] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-695 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.503276] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-695" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.503417] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-695" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.503683] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-695" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.503955] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.504127] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.504243] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.504455] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.504601] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.504809] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1119.504920] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1119.505038] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1119.505259] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1119.505259] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1119.505374] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1119.505473] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1119.523568] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1119.523730] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1119.523831] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1119.524012] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-695" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.524337] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-e0f8089f-1f06-423f-b2ee-5f542752b690 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.524507] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-e0f8089f-1f06-423f-b2ee-5f542752b690" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.524625] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-e0f8089f-1f06-423f-b2ee-5f542752b690" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.524876] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-e0f8089f-1f06-423f-b2ee-5f542752b690" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.525029] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0f8089f-1f06-423f-b2ee-5f542752b690',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.876175] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.876369] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.876558] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.876663] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.876756] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.876970] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 is going to be created. [ 1119.902720] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.902965] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.903113] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.903876] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.904183] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.926675] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 in Status: UNINITIALIZED for 2s [ 1119.959028] env[65943]: INFO networking_nsxv3.common.synchronization [req-92a46b6f-b23f-451a-866a-a48ec66e7d95 req-398e1e4a-9dfb-451c-bc59-0baede60f6e7 tempest-AttachInterfacesTestJSON-882476571 tempest-AttachInterfacesTestJSON-882476571-project-member] Enqueued Resource ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c with Priority: HIGHEST for action security_group_members [ 1119.959627] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c with Priority: HIGHEST for action security_group_members [ 1119.960035] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-735ba0f8-8502-49b1-93a7-4ac595ca177c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.960212] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.960282] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.960513] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.960676] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.960770] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.960830] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.960976] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.961079] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.961175] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('735ba0f8-8502-49b1-93a7-4ac595ca177c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.027235] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.027558] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.027723] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.028043] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.028237] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.028543] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.028705] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.028823] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.029103] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.029250] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.029559] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.029765] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.030072] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.030402] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.030595] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.030800] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: e0f8089f-1f06-423f-b2ee-5f542752b690 is going to be updated. [ 1120.060079] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.060354] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.060484] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.060759] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.060968] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.061225] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-e0f8089f-1f06-423f-b2ee-5f542752b690" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.463739] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('735ba0f8-8502-49b1-93a7-4ac595ca177c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.758381] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: SUCCESS [ 1120.758381] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 deletion is rescheduled due to dependency. [ 1120.758381] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.773063] env[65943]: INFO networking_nsxv3.common.synchronization [req-5e868942-01ea-4095-981c-c52837903f63 req-ab29b870-96df-4be8-9f41-a014cb10160a service nova] Enqueued Resource ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 with Priority: HIGHEST for action security_group_rules [ 1120.773063] env[65943]: INFO networking_nsxv3.common.synchronization [req-5e868942-01ea-4095-981c-c52837903f63 req-ab29b870-96df-4be8-9f41-a014cb10160a service nova] Enqueued Resource ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 with Priority: HIGHEST for action security_group_members [ 1120.773063] env[65943]: INFO networking_nsxv3.common.synchronization [req-5e868942-01ea-4095-981c-c52837903f63 req-ab29b870-96df-4be8-9f41-a014cb10160a service nova] Enqueued Resource ID: e0f8089f-1f06-423f-b2ee-5f542752b690 with Priority: HIGHEST for action port [ 1120.773063] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 with Priority: HIGHEST for action security_group_rules [ 1120.773799] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 with Priority: HIGHEST for action security_group_members [ 1120.774060] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0f8089f-1f06-423f-b2ee-5f542752b690 with Priority: HIGHEST for action port [ 1120.774473] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a97b14a2-a99a-4ce7-8cba-fd84de098977 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.774727] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.775243] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.775545] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.775764] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a97b14a2-a99a-4ce7-8cba-fd84de098977',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.777037] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-a97b14a2-a99a-4ce7-8cba-fd84de098977 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.777759] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.778198] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.778198] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.778198] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.778354] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.778354] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.778481] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.778567] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.778658] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a97b14a2-a99a-4ce7-8cba-fd84de098977',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.779675] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0f8089f-1f06-423f-b2ee-5f542752b690 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.779675] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0f8089f-1f06-423f-b2ee-5f542752b690" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.779675] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0f8089f-1f06-423f-b2ee-5f542752b690" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.779815] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0f8089f-1f06-423f-b2ee-5f542752b690" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.779848] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0f8089f-1f06-423f-b2ee-5f542752b690',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.967088] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('735ba0f8-8502-49b1-93a7-4ac595ca177c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.282176] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a97b14a2-a99a-4ce7-8cba-fd84de098977',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.283253] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-a97b14a2-a99a-4ce7-8cba-fd84de098977 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.283392] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.283727] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e0f8089f-1f06-423f-b2ee-5f542752b690 with status ACTIVE [ 1121.283727] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.283899] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.283899] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.284135] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.284135] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.284295] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.284375] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.284421] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.284570] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.284807] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.284807] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.284946] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.284946] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.285104] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.285183] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.285271] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e0f8089f-1f06-423f-b2ee-5f542752b690 is going to be updated. [ 1121.308861] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.309049] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.310050] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.310050] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.310050] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.310050] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0f8089f-1f06-423f-b2ee-5f542752b690" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.468710] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.469229] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.469229] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.469419] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.472880] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.472880] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c is going to be updated. [ 1121.503191] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.503452] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.503452] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.503597] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.503719] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.514047] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c in Status: IN_PROGRESS for 2s [ 1121.787545] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a97b14a2-a99a-4ce7-8cba-fd84de098977',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.938209] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 in Status: SUCCESS [ 1121.938513] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.938701] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.938994] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.939280] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.939455] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.939550] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.939774] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.939888] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.940035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.940165] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a24c880-984b-4cdd-bb2c-6117349d9d43',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.290619] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.290816] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.290866] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.291092] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.291461] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.291461] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 is going to be updated. [ 1122.324665] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.324896] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.324896] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.325105] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.325285] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.335524] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 in Status: IN_PROGRESS for 2s [ 1122.443598] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a24c880-984b-4cdd-bb2c-6117349d9d43 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.443868] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.443988] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.444360] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.444707] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.444895] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.445076] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.445305] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.445486] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.445817] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.446130] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a24c880-984b-4cdd-bb2c-6117349d9d43 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.446316] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.446440] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.446715] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.447103] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.447614] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.447614] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.447614] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.447788] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.447788] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.447862] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a24c880-984b-4cdd-bb2c-6117349d9d43',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.950560] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a24c880-984b-4cdd-bb2c-6117349d9d43: rpc.has_security_group_logging(os_id): False [ 1122.970472] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.970624] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.971109] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.971109] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.971109] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.971263] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.971332] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.971366] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.971521] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.971599] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.972605] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.972605] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.972605] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.972605] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.972605] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.972605] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.972605] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.972605] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.972605] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.973144] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.973144] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 is going to be created. [ 1123.032566] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.032708] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.032776] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.032991] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.033231] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.043888] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 in Status: IN_PROGRESS for 2s [ 1123.523773] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c in Status: SUCCESS [ 1123.524020] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.347436] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 in Status: SUCCESS [ 1124.350245] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.350245] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.350245] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.350245] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.350245] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.350245] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.350245] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.350245] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.350245] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.350245] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a97b14a2-a99a-4ce7-8cba-fd84de098977',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.852064] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a97b14a2-a99a-4ce7-8cba-fd84de098977',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.056122] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 in Status: SUCCESS [ 1125.056418] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.274458] env[65943]: INFO networking_nsxv3.common.synchronization [req-497da7bc-7196-47e4-8c1f-2dd0ed33d7cc req-2a8c48c9-0454-41b9-b978-4f093ae99179 tempest-ServerPasswordTestJSON-1673678623 tempest-ServerPasswordTestJSON-1673678623-project-member] Enqueued Resource ID: b3cf4dd4-6ece-41ef-bd05-4a81131c66c6 with Priority: HIGHEST for action security_group_members [ 1125.275328] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3cf4dd4-6ece-41ef-bd05-4a81131c66c6 with Priority: HIGHEST for action security_group_members [ 1125.277469] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3cf4dd4-6ece-41ef-bd05-4a81131c66c6 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.277589] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3cf4dd4-6ece-41ef-bd05-4a81131c66c6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.277632] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3cf4dd4-6ece-41ef-bd05-4a81131c66c6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.277874] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3cf4dd4-6ece-41ef-bd05-4a81131c66c6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.278032] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.278114] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.278169] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.279147] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.279147] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.279147] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3cf4dd4-6ece-41ef-bd05-4a81131c66c6',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.355767] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a97b14a2-a99a-4ce7-8cba-fd84de098977: rpc.has_security_group_logging(os_id): False [ 1125.375717] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.375871] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.376663] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.376663] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.376663] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.376663] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.376663] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.376663] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.376967] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.376967] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.376967] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 is going to be updated. [ 1125.437707] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.437914] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.437992] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.438261] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.438490] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.454521] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 in Status: IN_PROGRESS for 2s [ 1125.780498] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.780699] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.780841] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.781077] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.781190] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.781491] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.781621] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.781674] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.781818] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.781894] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.781997] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3cf4dd4-6ece-41ef-bd05-4a81131c66c6 is going to be updated. [ 1125.813108] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.813310] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.813358] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.813642] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.813724] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.824077] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3cf4dd4-6ece-41ef-bd05-4a81131c66c6 in Status: IN_PROGRESS for 2s [ 1126.099506] env[65943]: INFO networking_nsxv3.common.synchronization [req-5157430e-6191-4601-8da6-512d6e957d49 req-5a179d6d-8637-40a9-acb9-a3f68b4d0316 tempest-AttachInterfacesTestJSON-882476571 tempest-AttachInterfacesTestJSON-882476571-project-member] Enqueued Resource ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c with Priority: HIGHEST for action security_group_members [ 1126.100200] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c with Priority: HIGHEST for action security_group_members [ 1126.100574] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-735ba0f8-8502-49b1-93a7-4ac595ca177c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.101196] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.101280] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.101476] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.101629] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.101727] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.102554] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.102554] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.102554] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.102554] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('735ba0f8-8502-49b1-93a7-4ac595ca177c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.604955] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.604955] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.604955] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.605496] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.605496] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.605496] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.605496] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.605628] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.605811] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.605811] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.605916] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c is going to be updated. [ 1126.637896] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.638107] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.638241] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.638435] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.638775] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.649438] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c in Status: IN_PROGRESS for 2s [ 1127.255747] env[65943]: INFO networking_nsxv3.common.synchronization [req-82ff9bb7-36e3-46de-9be4-ca3bb3524576 req-8e5c8be3-ccea-4827-b72e-2abba74a25f6 tempest-DeleteServersTestJSON-1404918926 tempest-DeleteServersTestJSON-1404918926-project-member] Enqueued Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_members [ 1127.255747] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_members [ 1127.256110] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.256286] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.259469] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.259469] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.259469] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.259469] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.259469] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.259469] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.259469] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.259469] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.473047] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 in Status: SUCCESS [ 1127.473305] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.665167] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-749 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.665167] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-749" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.665763] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-749" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.666205] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-749" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.666635] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.666939] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.667260] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.667685] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.668025] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.668452] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1127.669586] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1127.669586] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1127.669586] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1127.669586] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1127.669586] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1127.669586] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1127.691358] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1127.691716] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1127.691953] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1127.692219] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-749" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.692690] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-eb73e3fa-12f3-4587-99ca-503ce045340e taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.693026] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-eb73e3fa-12f3-4587-99ca-503ce045340e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.693207] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-eb73e3fa-12f3-4587-99ca-503ce045340e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.693611] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-eb73e3fa-12f3-4587-99ca-503ce045340e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.694082] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb73e3fa-12f3-4587-99ca-503ce045340e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.760958] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.761162] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.761239] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.761493] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.761608] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.761786] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.761883] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.761944] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.762156] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.762245] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.762335] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 is going to be updated. [ 1127.791825] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.792049] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.792049] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.792270] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.792414] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.805061] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: IN_PROGRESS for 2s [ 1127.836574] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3cf4dd4-6ece-41ef-bd05-4a81131c66c6 in Status: SUCCESS [ 1127.836759] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3cf4dd4-6ece-41ef-bd05-4a81131c66c6 deletion is rescheduled due to dependency. [ 1127.836949] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3cf4dd4-6ece-41ef-bd05-4a81131c66c6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.196740] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.196970] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.197064] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.197384] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.197534] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.197714] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port eb73e3fa-12f3-4587-99ca-503ce045340e not found, creating... [ 1128.198065] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.198238] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.198355] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.198572] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.198711] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.199017] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.199217] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.199333] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.199544] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.199679] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.199816] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: eb73e3fa-12f3-4587-99ca-503ce045340e is going to be created. [ 1128.223707] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.223938] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.224050] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.224339] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.224571] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.224803] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-eb73e3fa-12f3-4587-99ca-503ce045340e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.661111] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c in Status: SUCCESS [ 1128.661307] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c deletion is rescheduled due to dependency. [ 1128.661453] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.982230] env[65943]: INFO networking_nsxv3.common.synchronization [req-82ff9bb7-36e3-46de-9be4-ca3bb3524576 req-474fe175-8e6c-416f-a786-5b47f567f86f service nova] Enqueued Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_rules [ 1128.982230] env[65943]: INFO networking_nsxv3.common.synchronization [req-82ff9bb7-36e3-46de-9be4-ca3bb3524576 req-474fe175-8e6c-416f-a786-5b47f567f86f service nova] Enqueued Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_members [ 1128.982230] env[65943]: INFO networking_nsxv3.common.synchronization [req-82ff9bb7-36e3-46de-9be4-ca3bb3524576 req-474fe175-8e6c-416f-a786-5b47f567f86f service nova] Enqueued Resource ID: eb73e3fa-12f3-4587-99ca-503ce045340e with Priority: HIGHEST for action port [ 1128.982654] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_rules [ 1128.982829] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_members [ 1128.982931] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb73e3fa-12f3-4587-99ca-503ce045340e with Priority: HIGHEST for action port [ 1128.984610] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.984610] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.984610] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.984610] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.984610] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.985633] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.985745] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.986010] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb73e3fa-12f3-4587-99ca-503ce045340e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.986131] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb73e3fa-12f3-4587-99ca-503ce045340e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.986199] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb73e3fa-12f3-4587-99ca-503ce045340e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.986386] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb73e3fa-12f3-4587-99ca-503ce045340e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.986465] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb73e3fa-12f3-4587-99ca-503ce045340e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.488175] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.488985] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.488985] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eb73e3fa-12f3-4587-99ca-503ce045340e with status ACTIVE [ 1129.489239] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.489578] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.489578] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.489706] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.489766] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.490021] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.490135] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.490188] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.490481] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.490481] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.490680] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.490783] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.490851] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.491039] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.491188] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.491293] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eb73e3fa-12f3-4587-99ca-503ce045340e is going to be updated. [ 1129.513993] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.514173] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.514243] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.514458] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.514596] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.514756] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb73e3fa-12f3-4587-99ca-503ce045340e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.815914] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: SUCCESS [ 1129.816196] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 deletion is rescheduled due to dependency. [ 1129.816372] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.816559] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.816787] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.816985] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.817149] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.817236] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.817438] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.817557] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.817676] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.320384] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.822956] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.326134] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.326134] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.326134] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.326799] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.326799] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.326799] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 is going to be updated. [ 1131.359966] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.360189] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.360264] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.360483] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.360706] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.373165] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: IN_PROGRESS for 2s [ 1133.389020] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: SUCCESS [ 1133.389421] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.389559] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.389711] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.389895] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.390071] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.390137] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.390425] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.390529] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.390631] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.390892] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.893785] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.893936] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.893996] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.894281] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.894586] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.894706] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.894790] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.894974] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.895252] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.895252] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.895435] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.895664] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.895664] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.895738] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.895908] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.896166] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.896166] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.896321] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.896351] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.896417] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.896552] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.984677] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1133.984785] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1134.019574] env[65943]: INFO networking_nsxv3.common.synchronization [None req-4757b4d3-4975-46f5-9ce8-e26eb93d94aa tempest-AttachInterfacesTestJSON-882476571 tempest-AttachInterfacesTestJSON-882476571-project-member] Enqueued Resource ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 with Priority: HIGHEST for action security_group_members [ 1134.021077] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 with Priority: HIGHEST for action security_group_members [ 1134.021077] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8a054b-6bee-465e-84da-d50dfdc27f64 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.021077] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.021077] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.021077] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.021313] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.021313] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.021313] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.021484] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.021518] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.021872] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c8a054b-6bee-465e-84da-d50dfdc27f64',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.399126] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15454ceb-9062-41fb-908b-b5ae144dbe65: rpc.has_security_group_logging(os_id): False [ 1134.418555] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.418742] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.418742] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.418956] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.419099] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.419342] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.419419] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.420129] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.420129] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.420129] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.420129] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.420129] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.420129] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.420322] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.420355] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.420516] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.420609] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.420668] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.420820] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.420905] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.420990] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 is going to be updated. [ 1134.488363] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.488505] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.488620] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.488827] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.488959] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.505447] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: IN_PROGRESS for 2s [ 1134.525194] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.525355] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.525427] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.525642] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.525738] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.525929] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.526042] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.526107] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.526263] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.526343] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.526434] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 is going to be updated. [ 1134.556687] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.556830] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.556899] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.557154] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.557399] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.589358] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 in Status: IN_PROGRESS for 2s [ 1136.014229] env[65943]: INFO networking_nsxv3.common.synchronization [req-740113a4-5167-407f-9b48-9f1e42beb66a req-f329d2e4-137d-4c29-a2ae-6071a3e6d4a7 tempest-ServerActionsTestOtherA-92071881 tempest-ServerActionsTestOtherA-92071881-project-member] Enqueued Resource ID: 3e3d8b17-4394-4674-b793-075706514abb with Priority: HIGHEST for action security_group_members [ 1136.014794] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3d8b17-4394-4674-b793-075706514abb with Priority: HIGHEST for action security_group_members [ 1136.015094] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3d8b17-4394-4674-b793-075706514abb taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.015366] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.015366] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.016032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.016032] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.016032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.016032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.016032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.016032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.016613] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e3d8b17-4394-4674-b793-075706514abb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.424885] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-863 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.424885] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-863" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.425156] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-863" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.425790] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-863" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.427070] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.427070] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.427070] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.427070] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.427070] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.427070] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1136.427368] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1136.427419] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1136.427558] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1136.427852] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1136.427852] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1136.427970] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1136.448770] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1136.448921] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1136.449026] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1136.449279] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-863" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.449779] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-e4377d48-f9cc-4302-9b7f-f7700da89197 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.449904] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-e4377d48-f9cc-4302-9b7f-f7700da89197" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.449988] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-e4377d48-f9cc-4302-9b7f-f7700da89197" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.450439] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-e4377d48-f9cc-4302-9b7f-f7700da89197" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.450818] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4377d48-f9cc-4302-9b7f-f7700da89197',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.520569] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e3d8b17-4394-4674-b793-075706514abb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.522283] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: SUCCESS [ 1136.522574] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.601782] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 in Status: SUCCESS [ 1136.601977] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c8a054b-6bee-465e-84da-d50dfdc27f64 deletion is rescheduled due to dependency. [ 1136.602256] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8a054b-6bee-465e-84da-d50dfdc27f64" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.954203] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.954443] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.954571] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.954852] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.955017] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.955496] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port e4377d48-f9cc-4302-9b7f-f7700da89197 not found, creating... [ 1136.955496] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.955634] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.955709] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.955913] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.956174] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.956450] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.956605] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.956719] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.956924] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.957124] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.957344] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: e4377d48-f9cc-4302-9b7f-f7700da89197 is going to be created. [ 1136.980567] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.980771] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.980921] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.981169] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.981413] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.981629] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-e4377d48-f9cc-4302-9b7f-f7700da89197" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.023393] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e3d8b17-4394-4674-b793-075706514abb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.526040] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.526237] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.526291] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.526491] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.526588] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.526761] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e3d8b17-4394-4674-b793-075706514abb is going to be updated. [ 1137.557622] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.557747] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.557802] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.558927] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.559342] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.568908] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3d8b17-4394-4674-b793-075706514abb in Status: IN_PROGRESS for 2s [ 1137.737686] env[65943]: INFO networking_nsxv3.common.synchronization [req-740113a4-5167-407f-9b48-9f1e42beb66a req-68a77cbc-fee0-49cf-8212-2fbae80d59bf service nova] Enqueued Resource ID: 3e3d8b17-4394-4674-b793-075706514abb with Priority: HIGHEST for action security_group_rules [ 1137.737987] env[65943]: INFO networking_nsxv3.common.synchronization [req-740113a4-5167-407f-9b48-9f1e42beb66a req-68a77cbc-fee0-49cf-8212-2fbae80d59bf service nova] Enqueued Resource ID: 3e3d8b17-4394-4674-b793-075706514abb with Priority: HIGHEST for action security_group_members [ 1137.738250] env[65943]: INFO networking_nsxv3.common.synchronization [req-740113a4-5167-407f-9b48-9f1e42beb66a req-68a77cbc-fee0-49cf-8212-2fbae80d59bf service nova] Enqueued Resource ID: e4377d48-f9cc-4302-9b7f-f7700da89197 with Priority: HIGHEST for action port [ 1137.739149] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3d8b17-4394-4674-b793-075706514abb with Priority: HIGHEST for action security_group_rules [ 1137.739442] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3d8b17-4394-4674-b793-075706514abb with Priority: HIGHEST for action security_group_members [ 1137.739730] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4377d48-f9cc-4302-9b7f-f7700da89197 with Priority: HIGHEST for action port [ 1137.740142] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e3d8b17-4394-4674-b793-075706514abb taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.740771] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.740884] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.741209] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.742906] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e3d8b17-4394-4674-b793-075706514abb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.744102] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3d8b17-4394-4674-b793-075706514abb taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.745255] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.745716] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4377d48-f9cc-4302-9b7f-f7700da89197 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.745716] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4377d48-f9cc-4302-9b7f-f7700da89197" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.746865] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4377d48-f9cc-4302-9b7f-f7700da89197" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.746865] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4377d48-f9cc-4302-9b7f-f7700da89197" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.746865] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4377d48-f9cc-4302-9b7f-f7700da89197',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.249757] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3d8b17-4394-4674-b793-075706514abb taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.250909] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.251726] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e4377d48-f9cc-4302-9b7f-f7700da89197 with status ACTIVE [ 1138.251726] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.251726] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.251726] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.254068] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.254068] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.254068] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.254068] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.254068] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.254068] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.254068] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.254068] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.254068] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.254068] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.254068] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.254517] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.254517] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e4377d48-f9cc-4302-9b7f-f7700da89197 is going to be updated. [ 1138.280423] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.280660] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.280768] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.281101] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.281324] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.281719] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4377d48-f9cc-4302-9b7f-f7700da89197" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.279173] env[65943]: INFO networking_nsxv3.common.synchronization [None req-490fd74c-19aa-402b-8adc-66effc8ca9dc None None] Enqueued Resource ID: 66de7f07-3daa-429c-8bfb-529c0fe59f09 with Priority: HIGHEST for action port [ 1139.280427] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66de7f07-3daa-429c-8bfb-529c0fe59f09 with Priority: HIGHEST for action port [ 1139.280845] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-66de7f07-3daa-429c-8bfb-529c0fe59f09 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.282271] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66de7f07-3daa-429c-8bfb-529c0fe59f09" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.282370] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66de7f07-3daa-429c-8bfb-529c0fe59f09" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.282571] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66de7f07-3daa-429c-8bfb-529c0fe59f09" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.282657] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66de7f07-3daa-429c-8bfb-529c0fe59f09',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.580700] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3d8b17-4394-4674-b793-075706514abb in Status: SUCCESS [ 1139.581118] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.581330] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.581586] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.581836] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.582055] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.582197] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.582476] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.582586] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.582697] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e3d8b17-4394-4674-b793-075706514abb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.733322] env[65943]: INFO networking_nsxv3.common.synchronization [None req-9d884800-2a92-41cc-acba-da5c16169718 tempest-AttachInterfacesUnderV243Test-1627395556 tempest-AttachInterfacesUnderV243Test-1627395556-project-member] Enqueued Resource ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 with Priority: HIGHEST for action security_group_rules [ 1139.733921] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 with Priority: HIGHEST for action security_group_rules [ 1139.735440] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38d21e96-89fb-4956-acd8-feb64ddca5d0 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.735440] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.735440] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.735440] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.735440] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38d21e96-89fb-4956-acd8-feb64ddca5d0',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.785101] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 66de7f07-3daa-429c-8bfb-529c0fe59f09 [ 1139.785101] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.785101] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.785101] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.785101] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.785574] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.785574] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:66de7f07-3daa-429c-8bfb-529c0fe59f09 already deleted. [ 1139.785574] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66de7f07-3daa-429c-8bfb-529c0fe59f09" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.820328] env[65943]: INFO networking_nsxv3.common.synchronization [None req-d5320bca-c9cd-467e-9cd5-501204595e35 tempest-AttachInterfacesUnderV243Test-1627395556 tempest-AttachInterfacesUnderV243Test-1627395556-project-member] Enqueued Resource ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 with Priority: HIGHEST for action security_group_rules [ 1139.821020] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 with Priority: HIGHEST for action security_group_rules [ 1139.821522] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38d21e96-89fb-4956-acd8-feb64ddca5d0 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.821522] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.084619] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e3d8b17-4394-4674-b793-075706514abb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.258208] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.258387] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.258439] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.258619] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.258709] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.258805] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 already deleted. [ 1140.258889] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.259057] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.259252] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.259401] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38d21e96-89fb-4956-acd8-feb64ddca5d0',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.589025] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e3d8b17-4394-4674-b793-075706514abb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.783710] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.783960] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.784114] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.784657] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.784657] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.784768] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 already deleted. [ 1140.784850] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.091059] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.091059] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.091059] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.091294] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.091294] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.091513] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e3d8b17-4394-4674-b793-075706514abb is going to be updated. [ 1141.129450] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.130228] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.130228] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.130228] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.130228] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.149529] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3d8b17-4394-4674-b793-075706514abb in Status: IN_PROGRESS for 2s [ 1141.976256] env[65943]: INFO networking_nsxv3.common.synchronization [None req-b712a584-1cab-4c18-afc5-506af31348e2 None None] Enqueued Resource ID: 40016d05-b22f-475f-b891-4ce3fdb2b7f5 with Priority: HIGHEST for action port [ 1141.976887] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40016d05-b22f-475f-b891-4ce3fdb2b7f5 with Priority: HIGHEST for action port [ 1141.977309] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-40016d05-b22f-475f-b891-4ce3fdb2b7f5 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.977712] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40016d05-b22f-475f-b891-4ce3fdb2b7f5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.977712] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40016d05-b22f-475f-b891-4ce3fdb2b7f5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.977870] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40016d05-b22f-475f-b891-4ce3fdb2b7f5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.977870] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40016d05-b22f-475f-b891-4ce3fdb2b7f5',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.479837] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 40016d05-b22f-475f-b891-4ce3fdb2b7f5 [ 1142.480201] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.480422] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.480498] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.480670] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.480761] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.480861] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:40016d05-b22f-475f-b891-4ce3fdb2b7f5 already deleted. [ 1142.480941] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40016d05-b22f-475f-b891-4ce3fdb2b7f5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.038129] env[65943]: INFO networking_nsxv3.common.synchronization [req-6e9f3ae5-b2c9-441a-82f7-1817b1460b26 req-4e8a4650-f34f-471c-b182-014388f8e438 tempest-ServerRescueTestJSON-1872144016 tempest-ServerRescueTestJSON-1872144016-project-member] Enqueued Resource ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 with Priority: HIGHEST for action security_group_members [ 1143.038129] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 with Priority: HIGHEST for action security_group_members [ 1143.038962] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a24c880-984b-4cdd-bb2c-6117349d9d43 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.039142] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.039235] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.039447] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.039623] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.039746] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.039844] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.040141] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.040317] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.040488] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a24c880-984b-4cdd-bb2c-6117349d9d43',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.164760] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3d8b17-4394-4674-b793-075706514abb in Status: SUCCESS [ 1143.164889] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.165032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.165276] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.165499] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.165650] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.165754] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.165911] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.165996] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.166110] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.166227] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e3d8b17-4394-4674-b793-075706514abb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.357043] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-874 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.357375] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-874" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.357503] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-874" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.357778] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-874" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.358064] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.358240] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.358355] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.358563] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.358757] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.358903] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1143.359018] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1143.359163] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1143.359287] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1143.359402] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1143.359505] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1143.359637] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1143.384690] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1143.384888] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1143.385046] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1143.385255] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-874" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.385646] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-86ddbcfb-2b19-40bf-b7f3-0476584deb39 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.385825] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-86ddbcfb-2b19-40bf-b7f3-0476584deb39" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.385944] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-86ddbcfb-2b19-40bf-b7f3-0476584deb39" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.386323] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-86ddbcfb-2b19-40bf-b7f3-0476584deb39" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.386531] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86ddbcfb-2b19-40bf-b7f3-0476584deb39',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.542866] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a24c880-984b-4cdd-bb2c-6117349d9d43',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.667957] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e3d8b17-4394-4674-b793-075706514abb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.889014] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.889341] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.889516] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.889834] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.890046] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.890316] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port 86ddbcfb-2b19-40bf-b7f3-0476584deb39 not found, creating... [ 1143.890866] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.890866] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.891033] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.891217] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.891422] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.891720] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.891881] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.891995] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.892236] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.892374] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.892513] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: 86ddbcfb-2b19-40bf-b7f3-0476584deb39 is going to be created. [ 1143.912907] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.913204] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.913312] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.913598] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.913847] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.914105] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-86ddbcfb-2b19-40bf-b7f3-0476584deb39" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.045489] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a24c880-984b-4cdd-bb2c-6117349d9d43',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.170248] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e3d8b17-4394-4674-b793-075706514abb: rpc.has_security_group_logging(os_id): False [ 1144.188355] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.188572] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.188572] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.188810] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.211253] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.212049] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.212392] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.212603] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.212912] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.213067] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.213215] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e3d8b17-4394-4674-b793-075706514abb is going to be updated. [ 1144.272050] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.272252] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.272252] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.272484] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.272695] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.284594] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e3d8b17-4394-4674-b793-075706514abb in Status: IN_PROGRESS for 2s [ 1144.548653] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.548746] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.548746] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.548969] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.549080] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.549206] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 is going to be updated. [ 1144.579455] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.579639] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.579680] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.579869] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.580031] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.588946] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 in Status: IN_PROGRESS for 2s [ 1144.640124] env[65943]: INFO networking_nsxv3.common.synchronization [req-6e9f3ae5-b2c9-441a-82f7-1817b1460b26 req-190f40dd-03b3-4893-ab7a-ec011e858a19 service nova] Enqueued Resource ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 with Priority: HIGHEST for action security_group_rules [ 1144.640729] env[65943]: INFO networking_nsxv3.common.synchronization [req-6e9f3ae5-b2c9-441a-82f7-1817b1460b26 req-190f40dd-03b3-4893-ab7a-ec011e858a19 service nova] Enqueued Resource ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 with Priority: HIGHEST for action security_group_members [ 1144.640729] env[65943]: INFO networking_nsxv3.common.synchronization [req-6e9f3ae5-b2c9-441a-82f7-1817b1460b26 req-190f40dd-03b3-4893-ab7a-ec011e858a19 service nova] Enqueued Resource ID: 86ddbcfb-2b19-40bf-b7f3-0476584deb39 with Priority: HIGHEST for action port [ 1144.640990] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 with Priority: HIGHEST for action security_group_rules [ 1144.641135] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 with Priority: HIGHEST for action security_group_members [ 1144.641233] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86ddbcfb-2b19-40bf-b7f3-0476584deb39 with Priority: HIGHEST for action port [ 1144.641567] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a24c880-984b-4cdd-bb2c-6117349d9d43 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.641697] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.641800] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.642037] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.642127] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a24c880-984b-4cdd-bb2c-6117349d9d43',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.642964] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a24c880-984b-4cdd-bb2c-6117349d9d43 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.643174] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.643397] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-86ddbcfb-2b19-40bf-b7f3-0476584deb39 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.643495] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86ddbcfb-2b19-40bf-b7f3-0476584deb39" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.643564] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86ddbcfb-2b19-40bf-b7f3-0476584deb39" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.643732] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86ddbcfb-2b19-40bf-b7f3-0476584deb39" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.643798] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86ddbcfb-2b19-40bf-b7f3-0476584deb39',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.145343] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a24c880-984b-4cdd-bb2c-6117349d9d43 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.145713] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.146900] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 86ddbcfb-2b19-40bf-b7f3-0476584deb39 with status ACTIVE [ 1145.147290] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.147456] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.147522] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.147729] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.147829] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.148087] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.148299] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.148371] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.148484] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.148574] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.148779] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.148905] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.148994] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.149237] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.149318] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.149408] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 86ddbcfb-2b19-40bf-b7f3-0476584deb39 is going to be updated. [ 1145.173150] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.173150] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.173150] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.173150] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.173150] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.173150] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86ddbcfb-2b19-40bf-b7f3-0476584deb39" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.300739] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e3d8b17-4394-4674-b793-075706514abb in Status: SUCCESS [ 1146.301059] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.599571] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 in Status: SUCCESS [ 1146.599793] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.599959] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.600255] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.600405] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.600540] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.600602] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.600750] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.600835] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.600930] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a24c880-984b-4cdd-bb2c-6117349d9d43',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.103020] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a24c880-984b-4cdd-bb2c-6117349d9d43',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.606299] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a24c880-984b-4cdd-bb2c-6117349d9d43',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.108909] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.109268] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.109382] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.109684] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.109832] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.109982] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 is going to be updated. [ 1148.140087] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.140316] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.140397] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.140646] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.140829] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.151028] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 in Status: IN_PROGRESS for 2s [ 1148.608687] env[65943]: INFO networking_nsxv3.common.synchronization [req-7ce89562-9149-4144-9e2f-1ae58333762c req-fcc33b70-0a72-451e-a759-9803bf26cb7a tempest-AttachInterfacesUnderV243Test-1627395556 tempest-AttachInterfacesUnderV243Test-1627395556-project-member] Enqueued Resource ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 with Priority: HIGHEST for action security_group_members [ 1148.609471] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 with Priority: HIGHEST for action security_group_members [ 1148.610015] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-38d21e96-89fb-4956-acd8-feb64ddca5d0 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.610176] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.610176] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.610496] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.610757] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.610916] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.611282] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.611282] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.611391] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.611540] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38d21e96-89fb-4956-acd8-feb64ddca5d0',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.944500] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-371 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.944797] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-371" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.944962] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-371" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.945370] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-371" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.945648] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.945807] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.945959] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.946151] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.946362] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.946703] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1148.946882] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1148.947016] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1148.947176] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1148.947275] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1148.947357] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1148.947479] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1148.968570] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1148.968814] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1148.968867] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1148.969060] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-371" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.969745] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-c3867076-f639-4330-92a0-8e3fdaa7a2ea taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.969973] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-c3867076-f639-4330-92a0-8e3fdaa7a2ea" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.970176] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-c3867076-f639-4330-92a0-8e3fdaa7a2ea" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.970491] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-c3867076-f639-4330-92a0-8e3fdaa7a2ea" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.970741] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3867076-f639-4330-92a0-8e3fdaa7a2ea',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.115144] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.115319] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.115388] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.115613] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.115702] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.115909] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.116011] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.116077] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.116230] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.116511] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.116511] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 already deleted. [ 1149.116511] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.473539] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.473774] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.473913] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.474228] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.474387] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.474546] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port c3867076-f639-4330-92a0-8e3fdaa7a2ea not found, creating... [ 1149.474822] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.474981] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.475135] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.475361] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.475525] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.475826] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.475988] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.476120] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.476339] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.476482] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.476623] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: c3867076-f639-4330-92a0-8e3fdaa7a2ea is going to be created. [ 1149.499694] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.500056] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.500056] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.500400] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.500667] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.500880] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-c3867076-f639-4330-92a0-8e3fdaa7a2ea" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.161637] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 in Status: SUCCESS [ 1150.162091] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.162329] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.162633] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.162890] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.163076] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.163174] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.163392] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.163508] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.163654] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.163790] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a24c880-984b-4cdd-bb2c-6117349d9d43',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.216508] env[65943]: INFO networking_nsxv3.common.synchronization [req-7ce89562-9149-4144-9e2f-1ae58333762c req-48921e19-e7ef-47f9-8879-9d53df8e79c3 service nova] Enqueued Resource ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 with Priority: HIGHEST for action security_group_rules [ 1150.216678] env[65943]: INFO networking_nsxv3.common.synchronization [req-7ce89562-9149-4144-9e2f-1ae58333762c req-48921e19-e7ef-47f9-8879-9d53df8e79c3 service nova] Enqueued Resource ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 with Priority: HIGHEST for action security_group_members [ 1150.216805] env[65943]: INFO networking_nsxv3.common.synchronization [req-7ce89562-9149-4144-9e2f-1ae58333762c req-48921e19-e7ef-47f9-8879-9d53df8e79c3 service nova] Enqueued Resource ID: c3867076-f639-4330-92a0-8e3fdaa7a2ea with Priority: HIGHEST for action port [ 1150.217661] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 with Priority: HIGHEST for action security_group_rules [ 1150.217661] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 with Priority: HIGHEST for action security_group_members [ 1150.217661] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3867076-f639-4330-92a0-8e3fdaa7a2ea with Priority: HIGHEST for action port [ 1150.218869] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38d21e96-89fb-4956-acd8-feb64ddca5d0 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.218869] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.218869] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.218869] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.218869] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38d21e96-89fb-4956-acd8-feb64ddca5d0',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.219904] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-38d21e96-89fb-4956-acd8-feb64ddca5d0 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.219904] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.219904] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.219904] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.219904] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.219904] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.219904] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.220216] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.220216] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.220216] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38d21e96-89fb-4956-acd8-feb64ddca5d0',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.220978] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3867076-f639-4330-92a0-8e3fdaa7a2ea taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.221095] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3867076-f639-4330-92a0-8e3fdaa7a2ea" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.221146] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3867076-f639-4330-92a0-8e3fdaa7a2ea" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.221293] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3867076-f639-4330-92a0-8e3fdaa7a2ea" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.221387] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3867076-f639-4330-92a0-8e3fdaa7a2ea',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.665931] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a24c880-984b-4cdd-bb2c-6117349d9d43 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.666157] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.666157] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.666354] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.666534] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.666633] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.666686] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.666842] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.666928] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.667025] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.667211] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a24c880-984b-4cdd-bb2c-6117349d9d43 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.667308] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.667357] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.667507] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.667643] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.667732] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.667789] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.667920] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.667995] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.668114] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.668212] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a24c880-984b-4cdd-bb2c-6117349d9d43',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.723087] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('38d21e96-89fb-4956-acd8-feb64ddca5d0',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.724165] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-38d21e96-89fb-4956-acd8-feb64ddca5d0 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.724312] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.724448] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3867076-f639-4330-92a0-8e3fdaa7a2ea with status ACTIVE [ 1150.724600] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.724746] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.724935] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.724984] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.725076] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.725322] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.725425] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.725465] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.725608] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.725682] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.725924] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.726081] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.726152] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.726347] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.726407] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.726504] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3867076-f639-4330-92a0-8e3fdaa7a2ea is going to be updated. [ 1150.749713] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.749902] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.749974] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.750152] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.750305] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.750456] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3867076-f639-4330-92a0-8e3fdaa7a2ea" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.170237] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a24c880-984b-4cdd-bb2c-6117349d9d43: rpc.has_security_group_logging(os_id): False [ 1151.189935] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.190262] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.190374] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.190639] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.190750] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.191042] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.191175] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.191288] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.191537] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.191631] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.191829] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.192041] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.192041] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.192232] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.192327] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.192563] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.192755] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.192755] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.192922] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.192970] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.193068] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 is going to be updated. [ 1151.229041] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('38d21e96-89fb-4956-acd8-feb64ddca5d0',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.264487] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.264707] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.264792] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.265070] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.265225] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.282286] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 in Status: IN_PROGRESS for 2s [ 1151.731995] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.732227] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.732365] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.732553] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.732685] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.732799] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 is going to be created. [ 1151.759569] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.759892] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.759892] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.760044] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.760307] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.772500] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 in Status: UNINITIALIZED for 2s [ 1153.296356] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 in Status: SUCCESS [ 1153.296356] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.783134] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 in Status: SUCCESS [ 1153.783347] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.783496] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.783712] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.783937] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.784032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.784093] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.784423] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.784423] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.784423] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.784536] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('38d21e96-89fb-4956-acd8-feb64ddca5d0',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.287481] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('38d21e96-89fb-4956-acd8-feb64ddca5d0',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.790153] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 38d21e96-89fb-4956-acd8-feb64ddca5d0: rpc.has_security_group_logging(os_id): False [ 1154.815450] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.815644] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.815797] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.816135] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.816231] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.816513] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.816616] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.816679] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.817229] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.817229] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.817229] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 is going to be created. [ 1154.901084] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.901301] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.901301] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.901536] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.901715] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.920587] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 in Status: IN_PROGRESS for 2s [ 1155.219311] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1155.219528] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1156.934745] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 in Status: SUCCESS [ 1156.935346] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.220250] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1160.220709] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1162.175579] env[65943]: INFO networking_nsxv3.common.synchronization [req-5b997e07-dc47-4018-a5d1-3d2d65940d20 req-83a594a5-34a8-4c75-9c53-88c8947a3bbf tempest-ServerActionsTestJSON-1587559204 tempest-ServerActionsTestJSON-1587559204-project-member] Enqueued Resource ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 with Priority: HIGHEST for action security_group_members [ 1162.175579] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 with Priority: HIGHEST for action security_group_members [ 1162.175579] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bcdadce-edf2-43d0-a8d9-43033bb27e63 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.175972] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.175972] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.176163] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.176338] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.176486] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.176541] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.176667] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.176752] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.176861] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bcdadce-edf2-43d0-a8d9-43033bb27e63',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.679580] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.680159] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.680159] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.680159] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.680159] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.680363] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.680457] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.680457] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.680638] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.680712] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.680801] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 is going to be updated. [ 1162.712855] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.713216] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.713216] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.713216] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.713480] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.722269] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 in Status: IN_PROGRESS for 2s [ 1164.738161] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 in Status: SUCCESS [ 1164.738161] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 deletion is rescheduled due to dependency. [ 1164.738161] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.176727] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1167.177150] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1170.494519] env[65943]: INFO networking_nsxv3.common.synchronization [req-a0c49e3d-0d7c-476c-92b2-cb0b3c91f311 req-cd07c3f8-8a06-4ed3-81ba-977ed61fc163 tempest-ServerRescueTestJSON-1872144016 tempest-ServerRescueTestJSON-1872144016-project-member] Enqueued Resource ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 with Priority: HIGHEST for action security_group_members [ 1170.496083] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 with Priority: HIGHEST for action security_group_members [ 1170.496083] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a24c880-984b-4cdd-bb2c-6117349d9d43 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.496335] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.496496] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.496804] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.497132] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.497376] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.497533] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.497772] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.497948] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.498215] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a24c880-984b-4cdd-bb2c-6117349d9d43',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.522617] env[65943]: INFO networking_nsxv3.common.synchronization [req-6bc23a37-eb20-4127-a6aa-f669c38942cc req-8e9c5f39-5a5e-494c-8d18-b001171405f5 tempest-ServerActionsTestJSON-1587559204 tempest-ServerActionsTestJSON-1587559204-project-member] Enqueued Resource ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 with Priority: HIGHEST for action security_group_members [ 1170.523265] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 with Priority: HIGHEST for action security_group_members [ 1170.523789] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bcdadce-edf2-43d0-a8d9-43033bb27e63 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.523896] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.523954] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.524557] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.524557] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.525382] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.526116] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.526116] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.526116] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.526116] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bcdadce-edf2-43d0-a8d9-43033bb27e63',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.859024] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-287 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.859024] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-287" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.859024] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-287" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.859024] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-287" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.859024] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.859024] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.859024] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.859024] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.859024] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.859024] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1170.859024] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1170.859024] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1170.859024] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1170.859660] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1170.859660] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1170.859660] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1170.880081] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1170.880318] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1170.880453] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1170.880630] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-287" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.880968] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-cdc937d5-0b99-48c4-8161-b8feb34b13fd taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.881205] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-cdc937d5-0b99-48c4-8161-b8feb34b13fd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.881342] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-cdc937d5-0b99-48c4-8161-b8feb34b13fd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.881767] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-cdc937d5-0b99-48c4-8161-b8feb34b13fd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.881909] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdc937d5-0b99-48c4-8161-b8feb34b13fd',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.002058] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a24c880-984b-4cdd-bb2c-6117349d9d43',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.028076] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.028283] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.028283] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.028493] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.028585] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.028777] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.028873] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.028927] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.029382] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.029382] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.029382] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 is going to be updated. [ 1171.053403] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.053556] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.053603] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.054133] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.054133] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.057444] env[65943]: INFO networking_nsxv3.common.synchronization [req-1fb18909-bbaa-4d7f-86ee-8ebde4431838 req-25fe9a09-34df-4fcb-9a83-4a32ebcb9708 tempest-DeleteServersTestJSON-1404918926 tempest-DeleteServersTestJSON-1404918926-project-member] Enqueued Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_members [ 1171.058089] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGHEST for action security_group_members [ 1171.058391] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.058504] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.058566] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.058754] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.058898] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.058996] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.059068] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.059212] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.059333] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.059411] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.064433] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 in Status: IN_PROGRESS for 2s [ 1171.384807] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.384807] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.384807] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.385088] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.385088] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.385233] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port cdc937d5-0b99-48c4-8161-b8feb34b13fd not found, creating... [ 1171.385516] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.385696] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.385808] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.386032] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.386171] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.386452] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.386604] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.386719] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.386923] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.387065] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.387203] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: cdc937d5-0b99-48c4-8161-b8feb34b13fd is going to be created. [ 1171.408391] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.408590] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.408805] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.409158] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.409593] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.409874] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-cdc937d5-0b99-48c4-8161-b8feb34b13fd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.503782] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a24c880-984b-4cdd-bb2c-6117349d9d43',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.561262] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.561468] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.561468] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.561688] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.561780] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.561985] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.562507] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.562608] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.562740] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.562822] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.562916] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 is going to be updated. [ 1171.589892] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.590099] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.590143] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.590377] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.590545] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.600185] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: IN_PROGRESS for 2s [ 1172.006779] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.007044] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.007122] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.007348] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.007437] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.007542] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 is going to be updated. [ 1172.034866] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.034984] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.035029] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.035329] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.035402] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.043897] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 in Status: IN_PROGRESS for 2s [ 1172.102811] env[65943]: INFO networking_nsxv3.common.synchronization [req-6bc23a37-eb20-4127-a6aa-f669c38942cc req-4bba01c0-73de-463a-9aae-2e57ebcfa288 service nova] Enqueued Resource ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 with Priority: HIGHEST for action security_group_rules [ 1172.103009] env[65943]: INFO networking_nsxv3.common.synchronization [req-6bc23a37-eb20-4127-a6aa-f669c38942cc req-4bba01c0-73de-463a-9aae-2e57ebcfa288 service nova] Enqueued Resource ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 with Priority: HIGHEST for action security_group_members [ 1172.103153] env[65943]: INFO networking_nsxv3.common.synchronization [req-6bc23a37-eb20-4127-a6aa-f669c38942cc req-4bba01c0-73de-463a-9aae-2e57ebcfa288 service nova] Enqueued Resource ID: cdc937d5-0b99-48c4-8161-b8feb34b13fd with Priority: HIGHEST for action port [ 1172.103701] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 with Priority: HIGHEST for action security_group_rules [ 1172.103843] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 with Priority: HIGHEST for action security_group_members [ 1172.104364] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdc937d5-0b99-48c4-8161-b8feb34b13fd with Priority: HIGHEST for action port [ 1172.104364] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.104364] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.104559] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.104591] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.104650] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7bcdadce-edf2-43d0-a8d9-43033bb27e63',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.105780] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bcdadce-edf2-43d0-a8d9-43033bb27e63 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.105887] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.106142] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-cdc937d5-0b99-48c4-8161-b8feb34b13fd taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.106229] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cdc937d5-0b99-48c4-8161-b8feb34b13fd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.106263] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cdc937d5-0b99-48c4-8161-b8feb34b13fd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.107017] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cdc937d5-0b99-48c4-8161-b8feb34b13fd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.107017] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdc937d5-0b99-48c4-8161-b8feb34b13fd',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.608513] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bcdadce-edf2-43d0-a8d9-43033bb27e63 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.608852] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.608852] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cdc937d5-0b99-48c4-8161-b8feb34b13fd with status ACTIVE [ 1172.608944] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.609063] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.609141] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.609362] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.609475] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.609632] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.609711] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.609804] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.609920] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.609996] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.610194] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.610290] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.610339] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.610525] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.610620] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.610690] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cdc937d5-0b99-48c4-8161-b8feb34b13fd is going to be updated. [ 1172.634306] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.634471] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.634524] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.634725] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.634860] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.635034] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cdc937d5-0b99-48c4-8161-b8feb34b13fd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.074706] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 in Status: SUCCESS [ 1173.074877] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 deletion is rescheduled due to dependency. [ 1173.074984] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.075152] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.075395] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.075600] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.075714] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.075778] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.075938] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.076086] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.076144] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bcdadce-edf2-43d0-a8d9-43033bb27e63',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.579137] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7bcdadce-edf2-43d0-a8d9-43033bb27e63',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.610600] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: IN_PROGRESS for 4s [ 1174.055810] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 in Status: SUCCESS [ 1174.056180] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.081750] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7bcdadce-edf2-43d0-a8d9-43033bb27e63',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.584311] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.584474] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.584545] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.585215] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.585215] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.585215] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 is going to be updated. [ 1174.613032] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.613032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.613032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.613032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.613525] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.625518] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 in Status: IN_PROGRESS for 2s [ 1175.620452] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 in Status: SUCCESS [ 1175.620750] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 deletion is rescheduled due to dependency. [ 1175.620750] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.256379] env[65943]: INFO networking_nsxv3.common.synchronization [req-bf8ba7c8-9044-40a1-b779-f618181335a6 req-4b90735f-309f-47c4-af95-51b4a2917390 tempest-AttachVolumeShelveTestJSON-1945734723 tempest-AttachVolumeShelveTestJSON-1945734723-project-member] Enqueued Resource ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 with Priority: HIGHEST for action security_group_members [ 1176.257060] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 with Priority: HIGHEST for action security_group_members [ 1176.257490] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-a97b14a2-a99a-4ce7-8cba-fd84de098977 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.257641] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.257753] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.257962] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.258250] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.258335] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.258375] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.258554] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.258682] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.258787] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a97b14a2-a99a-4ce7-8cba-fd84de098977',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.638722] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 in Status: IN_PROGRESS for 4s [ 1176.762188] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.762188] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.762188] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.762188] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.762188] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.762517] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.762517] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.762587] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.762698] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.762777] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.762873] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 is going to be updated. [ 1176.789575] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.789575] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.789575] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.789849] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.789849] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.798736] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 in Status: IN_PROGRESS for 2s [ 1178.412094] env[65943]: INFO networking_nsxv3.common.synchronization [req-5668e20c-9d4d-4c41-8a60-76eef8926efb req-ec4607dc-ab69-441b-aab6-252dfd7ebe05 tempest-ServerRescueTestJSON-1872144016 tempest-ServerRescueTestJSON-1872144016-project-member] Enqueued Resource ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 with Priority: HIGHEST for action security_group_members [ 1178.412381] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 with Priority: HIGHEST for action security_group_members [ 1178.413021] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a24c880-984b-4cdd-bb2c-6117349d9d43 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.413021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.413021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.413021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.413236] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.413236] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.413305] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.413434] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.413515] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.413607] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a24c880-984b-4cdd-bb2c-6117349d9d43',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.648167] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 in Status: SUCCESS [ 1178.648407] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.648587] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.648806] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.648998] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.649124] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.649185] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.649350] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.649439] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.649521] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.649604] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7bcdadce-edf2-43d0-a8d9-43033bb27e63',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.808844] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 in Status: SUCCESS [ 1178.809088] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 deletion is rescheduled due to dependency. [ 1178.809151] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.916827] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.917062] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.917167] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.917333] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.917428] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.917676] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.917754] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.917846] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.917960] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.918086] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.918174] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 is going to be updated. [ 1178.951066] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.951263] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.951334] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.951612] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.951802] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.963154] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 in Status: IN_PROGRESS for 2s [ 1179.153565] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7bcdadce-edf2-43d0-a8d9-43033bb27e63',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.656256] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7bcdadce-edf2-43d0-a8d9-43033bb27e63: rpc.has_security_group_logging(os_id): False [ 1179.674439] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.674439] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.674439] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.674648] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.674700] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.674989] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.675108] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.675159] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.675320] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.675394] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.675485] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 is going to be updated. [ 1179.774796] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.774963] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.775100] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.775317] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.775401] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.788231] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 in Status: IN_PROGRESS for 2s [ 1180.974492] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 in Status: SUCCESS [ 1180.974492] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 deletion is rescheduled due to dependency. [ 1180.974492] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.803159] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 in Status: SUCCESS [ 1181.803377] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.056347] env[65943]: INFO networking_nsxv3.common.synchronization [None req-c6b3471d-3fef-4a09-8c3d-3d231137bf20 None None] Enqueued Resource ID: 9396b94c-d365-4950-81a3-b015fa6a8901 with Priority: HIGHEST for action port [ 1182.056909] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9396b94c-d365-4950-81a3-b015fa6a8901 with Priority: HIGHEST for action port [ 1182.057371] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-9396b94c-d365-4950-81a3-b015fa6a8901 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.057524] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9396b94c-d365-4950-81a3-b015fa6a8901" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.057589] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9396b94c-d365-4950-81a3-b015fa6a8901" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.057849] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9396b94c-d365-4950-81a3-b015fa6a8901" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.057934] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9396b94c-d365-4950-81a3-b015fa6a8901',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.560265] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9396b94c-d365-4950-81a3-b015fa6a8901 [ 1182.560429] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.560525] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.560598] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.560848] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.560944] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.561060] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9396b94c-d365-4950-81a3-b015fa6a8901 already deleted. [ 1182.561139] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9396b94c-d365-4950-81a3-b015fa6a8901" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.058126] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1187.058517] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1191.948503] env[65943]: INFO networking_nsxv3.common.synchronization [None req-5448893d-e93c-417f-b93b-4710893db58d None None] Enqueued Resource ID: f79f63f5-5e0a-41b9-b307-6b9386395512 with Priority: HIGHEST for action port [ 1191.948977] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f79f63f5-5e0a-41b9-b307-6b9386395512 with Priority: HIGHEST for action port [ 1191.949139] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-f79f63f5-5e0a-41b9-b307-6b9386395512 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.949262] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f79f63f5-5e0a-41b9-b307-6b9386395512" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.949328] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f79f63f5-5e0a-41b9-b307-6b9386395512" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.949663] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f79f63f5-5e0a-41b9-b307-6b9386395512" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.949746] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f79f63f5-5e0a-41b9-b307-6b9386395512',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.140745] env[65943]: INFO networking_nsxv3.common.synchronization [None req-a9f068d3-b07d-46b6-9f09-afbb55d5e1be tempest-AttachVolumeNegativeTest-962354070 tempest-AttachVolumeNegativeTest-962354070-project-member] Enqueued Resource ID: 9ec3969d-7444-46cd-8273-33276cfbb49e with Priority: HIGHEST for action security_group_rules [ 1192.141326] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ec3969d-7444-46cd-8273-33276cfbb49e with Priority: HIGHEST for action security_group_rules [ 1192.141637] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ec3969d-7444-46cd-8273-33276cfbb49e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.141779] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ec3969d-7444-46cd-8273-33276cfbb49e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.142582] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ec3969d-7444-46cd-8273-33276cfbb49e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.142582] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ec3969d-7444-46cd-8273-33276cfbb49e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.142582] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ec3969d-7444-46cd-8273-33276cfbb49e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.236674] env[65943]: INFO networking_nsxv3.common.synchronization [None req-b31fd80f-79da-404e-aad5-28060b3c540e tempest-AttachVolumeNegativeTest-962354070 tempest-AttachVolumeNegativeTest-962354070-project-member] Enqueued Resource ID: 9ec3969d-7444-46cd-8273-33276cfbb49e with Priority: HIGHEST for action security_group_rules [ 1192.237066] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ec3969d-7444-46cd-8273-33276cfbb49e with Priority: HIGHEST for action security_group_rules [ 1192.237769] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ec3969d-7444-46cd-8273-33276cfbb49e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.237936] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ec3969d-7444-46cd-8273-33276cfbb49e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.452575] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f79f63f5-5e0a-41b9-b307-6b9386395512 [ 1192.453193] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.453193] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.453412] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.453449] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.453543] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.453648] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f79f63f5-5e0a-41b9-b307-6b9386395512 already deleted. [ 1192.453813] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f79f63f5-5e0a-41b9-b307-6b9386395512" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.667672] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.667916] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.667916] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.668133] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.668239] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.668368] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ec3969d-7444-46cd-8273-33276cfbb49e already deleted. [ 1192.668499] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ec3969d-7444-46cd-8273-33276cfbb49e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.668701] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ec3969d-7444-46cd-8273-33276cfbb49e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.668920] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ec3969d-7444-46cd-8273-33276cfbb49e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.669062] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ec3969d-7444-46cd-8273-33276cfbb49e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.192083] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.192423] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.192423] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.192537] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.192622] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.192758] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ec3969d-7444-46cd-8273-33276cfbb49e already deleted. [ 1193.192856] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ec3969d-7444-46cd-8273-33276cfbb49e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.150412] env[65943]: INFO networking_nsxv3.common.synchronization [None req-8a97b0d1-143f-4bff-9708-c1a640ed8a02 None None] Enqueued Resource ID: bea395da-5d3e-4ed7-84b4-2be46b1eeea6 with Priority: HIGHEST for action port [ 1194.151062] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bea395da-5d3e-4ed7-84b4-2be46b1eeea6 with Priority: HIGHEST for action port [ 1194.151347] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-bea395da-5d3e-4ed7-84b4-2be46b1eeea6 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.151477] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bea395da-5d3e-4ed7-84b4-2be46b1eeea6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.151540] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bea395da-5d3e-4ed7-84b4-2be46b1eeea6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.151787] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bea395da-5d3e-4ed7-84b4-2be46b1eeea6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.151872] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bea395da-5d3e-4ed7-84b4-2be46b1eeea6',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.653922] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bea395da-5d3e-4ed7-84b4-2be46b1eeea6 [ 1194.654315] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.654383] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.654383] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.654729] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.654846] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.654951] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bea395da-5d3e-4ed7-84b4-2be46b1eeea6 already deleted. [ 1194.655083] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bea395da-5d3e-4ed7-84b4-2be46b1eeea6" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.907203] env[65943]: INFO networking_nsxv3.common.synchronization [req-312bb452-89ef-4542-8ad5-06b0a33f84dc req-6e8eebc8-924f-48c4-9cab-449b21c0de95 tempest-AttachVolumeNegativeTest-962354070 tempest-AttachVolumeNegativeTest-962354070-project-member] Enqueued Resource ID: 9ec3969d-7444-46cd-8273-33276cfbb49e with Priority: HIGHEST for action security_group_members [ 1197.907451] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ec3969d-7444-46cd-8273-33276cfbb49e with Priority: HIGHEST for action security_group_members [ 1197.907894] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ec3969d-7444-46cd-8273-33276cfbb49e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.908034] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ec3969d-7444-46cd-8273-33276cfbb49e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.908102] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ec3969d-7444-46cd-8273-33276cfbb49e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.908376] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ec3969d-7444-46cd-8273-33276cfbb49e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.908531] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.908817] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.908817] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.908915] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.908953] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.909028] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ec3969d-7444-46cd-8273-33276cfbb49e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.911981] env[65943]: INFO networking_nsxv3.common.synchronization [req-7076bc5a-e9f5-4474-96a1-cfe1f5121af9 req-b36c7300-5725-4cb2-a625-a9b8e4cd5b0c tempest-AttachInterfacesUnderV243Test-1627395556 tempest-AttachInterfacesUnderV243Test-1627395556-project-member] Enqueued Resource ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 with Priority: HIGHEST for action security_group_members [ 1197.912235] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 with Priority: HIGHEST for action security_group_members [ 1197.912709] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-38d21e96-89fb-4956-acd8-feb64ddca5d0 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.912906] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.912906] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.913086] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.913229] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.913322] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.913383] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.913524] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.913606] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.913722] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38d21e96-89fb-4956-acd8-feb64ddca5d0',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.939501] env[65943]: INFO networking_nsxv3.common.synchronization [req-7076bc5a-e9f5-4474-96a1-cfe1f5121af9 req-b36c7300-5725-4cb2-a625-a9b8e4cd5b0c tempest-AttachInterfacesUnderV243Test-1627395556 tempest-AttachInterfacesUnderV243Test-1627395556-project-member] Enqueued Resource ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 with Priority: HIGHEST for action security_group_rules [ 1197.939714] env[65943]: INFO networking_nsxv3.common.synchronization [req-7076bc5a-e9f5-4474-96a1-cfe1f5121af9 req-b36c7300-5725-4cb2-a625-a9b8e4cd5b0c tempest-AttachInterfacesUnderV243Test-1627395556 tempest-AttachInterfacesUnderV243Test-1627395556-project-member] Enqueued Resource ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 with Priority: HIGHEST for action security_group_members [ 1197.939835] env[65943]: INFO networking_nsxv3.common.synchronization [req-7076bc5a-e9f5-4474-96a1-cfe1f5121af9 req-b36c7300-5725-4cb2-a625-a9b8e4cd5b0c tempest-AttachInterfacesUnderV243Test-1627395556 tempest-AttachInterfacesUnderV243Test-1627395556-project-member] Enqueued Resource ID: c3867076-f639-4330-92a0-8e3fdaa7a2ea with Priority: HIGHEST for action port [ 1197.940815] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 with Priority: HIGHEST for action security_group_rules [ 1197.940953] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 with Priority: HIGHEST for action security_group_members [ 1197.941066] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3867076-f639-4330-92a0-8e3fdaa7a2ea with Priority: HIGHEST for action port [ 1197.941371] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38d21e96-89fb-4956-acd8-feb64ddca5d0 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.941494] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.941649] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.941765] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.941849] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38d21e96-89fb-4956-acd8-feb64ddca5d0',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.942698] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-38d21e96-89fb-4956-acd8-feb64ddca5d0 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.942767] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.942922] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3867076-f639-4330-92a0-8e3fdaa7a2ea taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.943030] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3867076-f639-4330-92a0-8e3fdaa7a2ea" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.943098] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3867076-f639-4330-92a0-8e3fdaa7a2ea" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.943259] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3867076-f639-4330-92a0-8e3fdaa7a2ea" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.943326] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3867076-f639-4330-92a0-8e3fdaa7a2ea',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.235589] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-94 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.235794] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-94" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.235918] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-94" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.236295] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-94" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.236879] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.237066] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.237188] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.237421] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.237565] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.237774] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1198.237888] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1198.237997] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1198.238146] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1198.238235] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1198.238340] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1198.238473] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1198.261377] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1198.261585] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1198.261767] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1198.261989] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-94" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.262358] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-b18692ad-2125-4db7-aed0-1ebf24c1f842 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.262561] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-b18692ad-2125-4db7-aed0-1ebf24c1f842" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.262715] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-b18692ad-2125-4db7-aed0-1ebf24c1f842" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.263349] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-b18692ad-2125-4db7-aed0-1ebf24c1f842" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.263522] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b18692ad-2125-4db7-aed0-1ebf24c1f842',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.411671] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.411866] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.411976] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.412326] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.412477] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.412837] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.412837] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.413090] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.413090] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.413156] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.413188] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ec3969d-7444-46cd-8273-33276cfbb49e already deleted. [ 1198.413263] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ec3969d-7444-46cd-8273-33276cfbb49e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.415706] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('38d21e96-89fb-4956-acd8-feb64ddca5d0',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.445058] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-38d21e96-89fb-4956-acd8-feb64ddca5d0 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.445058] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.445246] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3867076-f639-4330-92a0-8e3fdaa7a2ea with status ACTIVE [ 1198.445396] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.445477] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.445524] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.445810] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.445919] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.446043] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.446183] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.446183] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.446350] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.446420] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.446618] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.446739] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.446791] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.446937] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.447034] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.447104] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3867076-f639-4330-92a0-8e3fdaa7a2ea is going to be updated. [ 1198.471449] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.471656] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.471696] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.471913] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.472086] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.472259] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3867076-f639-4330-92a0-8e3fdaa7a2ea" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.767730] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.767984] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.768155] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.768440] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.768688] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.768752] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port b18692ad-2125-4db7-aed0-1ebf24c1f842 not found, creating... [ 1198.769018] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.769176] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.769288] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.769522] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.769734] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.769994] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.770165] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.770279] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.770486] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.770641] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.770813] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: b18692ad-2125-4db7-aed0-1ebf24c1f842 is going to be created. [ 1198.789982] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.790201] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.790325] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.790741] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.790976] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.791221] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-b18692ad-2125-4db7-aed0-1ebf24c1f842" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.918227] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('38d21e96-89fb-4956-acd8-feb64ddca5d0',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.421181] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.421530] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.421654] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.421921] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.422072] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.422227] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 is going to be updated. [ 1199.452336] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.452336] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.452336] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.452336] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.452336] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.461654] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 in Status: IN_PROGRESS for 2s [ 1199.485206] env[65943]: INFO networking_nsxv3.common.synchronization [req-312bb452-89ef-4542-8ad5-06b0a33f84dc req-b79fb365-7fcb-41c6-9df1-a284bbf78f9d service nova] Enqueued Resource ID: 9ec3969d-7444-46cd-8273-33276cfbb49e with Priority: HIGHEST for action security_group_rules [ 1199.485206] env[65943]: INFO networking_nsxv3.common.synchronization [req-312bb452-89ef-4542-8ad5-06b0a33f84dc req-b79fb365-7fcb-41c6-9df1-a284bbf78f9d service nova] Enqueued Resource ID: 9ec3969d-7444-46cd-8273-33276cfbb49e with Priority: HIGHEST for action security_group_members [ 1199.485206] env[65943]: INFO networking_nsxv3.common.synchronization [req-312bb452-89ef-4542-8ad5-06b0a33f84dc req-b79fb365-7fcb-41c6-9df1-a284bbf78f9d service nova] Enqueued Resource ID: b18692ad-2125-4db7-aed0-1ebf24c1f842 with Priority: HIGHEST for action port [ 1199.486127] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ec3969d-7444-46cd-8273-33276cfbb49e with Priority: HIGHEST for action security_group_rules [ 1199.486272] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ec3969d-7444-46cd-8273-33276cfbb49e with Priority: HIGHEST for action security_group_members [ 1199.486371] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b18692ad-2125-4db7-aed0-1ebf24c1f842 with Priority: HIGHEST for action port [ 1199.486697] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ec3969d-7444-46cd-8273-33276cfbb49e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.486822] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ec3969d-7444-46cd-8273-33276cfbb49e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.486886] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ec3969d-7444-46cd-8273-33276cfbb49e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.489783] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ec3969d-7444-46cd-8273-33276cfbb49e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.489783] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ec3969d-7444-46cd-8273-33276cfbb49e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.489783] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ec3969d-7444-46cd-8273-33276cfbb49e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.489783] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ec3969d-7444-46cd-8273-33276cfbb49e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.489783] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ec3969d-7444-46cd-8273-33276cfbb49e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.489783] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ec3969d-7444-46cd-8273-33276cfbb49e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.489783] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.490058] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.490581] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.490927] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.490927] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.491076] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ec3969d-7444-46cd-8273-33276cfbb49e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.492455] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-b18692ad-2125-4db7-aed0-1ebf24c1f842 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.493371] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b18692ad-2125-4db7-aed0-1ebf24c1f842" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.493503] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b18692ad-2125-4db7-aed0-1ebf24c1f842" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.494408] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b18692ad-2125-4db7-aed0-1ebf24c1f842" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.494558] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b18692ad-2125-4db7-aed0-1ebf24c1f842',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.996320] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ec3969d-7444-46cd-8273-33276cfbb49e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.997569] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ec3969d-7444-46cd-8273-33276cfbb49e taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.997715] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ec3969d-7444-46cd-8273-33276cfbb49e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.997891] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b18692ad-2125-4db7-aed0-1ebf24c1f842 with status ACTIVE [ 1199.998101] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.998233] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.998296] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.998532] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.998634] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.998821] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.998934] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.999017] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.999187] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.999281] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.999522] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.999645] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.999712] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.999844] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.000021] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.000021] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b18692ad-2125-4db7-aed0-1ebf24c1f842 is going to be updated. [ 1200.019699] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.019931] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.019931] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.020139] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.020278] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.020454] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b18692ad-2125-4db7-aed0-1ebf24c1f842" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.458756] env[65943]: INFO networking_nsxv3.common.synchronization [req-3543f64c-7e50-4df6-8318-520154f46482 req-33f294e6-1497-487a-9b56-cd27211cdb81 tempest-AttachInterfacesUnderV243Test-1627395556 tempest-AttachInterfacesUnderV243Test-1627395556-project-member] Enqueued Resource ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 with Priority: HIGHEST for action security_group_members [ 1200.459402] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 with Priority: HIGHEST for action security_group_members [ 1200.459867] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-38d21e96-89fb-4956-acd8-feb64ddca5d0 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.460048] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.474525] env[65943]: INFO networking_nsxv3.common.synchronization [req-3543f64c-7e50-4df6-8318-520154f46482 req-33f294e6-1497-487a-9b56-cd27211cdb81 tempest-AttachInterfacesUnderV243Test-1627395556 tempest-AttachInterfacesUnderV243Test-1627395556-project-member] Enqueued Resource ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 with Priority: HIGHEST for action security_group_rules [ 1200.475113] env[65943]: INFO networking_nsxv3.common.synchronization [req-3543f64c-7e50-4df6-8318-520154f46482 req-33f294e6-1497-487a-9b56-cd27211cdb81 tempest-AttachInterfacesUnderV243Test-1627395556 tempest-AttachInterfacesUnderV243Test-1627395556-project-member] Enqueued Resource ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 with Priority: HIGHEST for action security_group_members [ 1200.475113] env[65943]: INFO networking_nsxv3.common.synchronization [req-3543f64c-7e50-4df6-8318-520154f46482 req-33f294e6-1497-487a-9b56-cd27211cdb81 tempest-AttachInterfacesUnderV243Test-1627395556 tempest-AttachInterfacesUnderV243Test-1627395556-project-member] Enqueued Resource ID: c3867076-f639-4330-92a0-8e3fdaa7a2ea with Priority: HIGHEST for action port [ 1200.475492] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 with Priority: HIGHEST for action security_group_rules [ 1200.475631] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 with Priority: HIGHEST for action security_group_members [ 1200.475728] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3867076-f639-4330-92a0-8e3fdaa7a2ea with Priority: HIGHEST for action port [ 1200.476998] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38d21e96-89fb-4956-acd8-feb64ddca5d0 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.476998] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.477313] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-38d21e96-89fb-4956-acd8-feb64ddca5d0 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.477313] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.477585] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3867076-f639-4330-92a0-8e3fdaa7a2ea taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.477585] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3867076-f639-4330-92a0-8e3fdaa7a2ea" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.477692] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3867076-f639-4330-92a0-8e3fdaa7a2ea" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.477822] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3867076-f639-4330-92a0-8e3fdaa7a2ea" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.477904] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3867076-f639-4330-92a0-8e3fdaa7a2ea',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.502322] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ec3969d-7444-46cd-8273-33276cfbb49e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.708133] env[65943]: INFO networking_nsxv3.common.synchronization [req-d8b14931-2d44-44f1-a85f-1f7189957692 req-65ad96fc-fdf3-404b-bbd0-32a55a13e463 tempest-ServerActionsTestOtherB-2092325239 tempest-ServerActionsTestOtherB-2092325239-project-member] Enqueued Resource ID: 2880c629-d8d0-45b5-b939-d99c78caab70 with Priority: HIGHEST for action security_group_members [ 1200.708765] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2880c629-d8d0-45b5-b939-d99c78caab70 with Priority: HIGHEST for action security_group_members [ 1200.709532] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2880c629-d8d0-45b5-b939-d99c78caab70 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.709652] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.709693] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.709898] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.710191] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.710319] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.710388] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.710594] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.710689] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.710791] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2880c629-d8d0-45b5-b939-d99c78caab70',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.980209] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3867076-f639-4330-92a0-8e3fdaa7a2ea with status ACTIVE [ 1200.980502] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.980687] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.980772] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.981095] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.981139] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.981320] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.981433] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.981498] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.981650] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.981726] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.981926] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.982030] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.982082] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.982220] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.982293] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.982377] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3867076-f639-4330-92a0-8e3fdaa7a2ea is going to be updated. [ 1201.004192] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.004483] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.004483] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.004597] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.004885] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.004885] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3867076-f639-4330-92a0-8e3fdaa7a2ea" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.005218] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.005315] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.005431] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.005529] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.005606] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.005693] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ec3969d-7444-46cd-8273-33276cfbb49e is going to be created. [ 1201.030663] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.030663] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.030930] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.030992] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.031826] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.044028] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ec3969d-7444-46cd-8273-33276cfbb49e in Status: UNINITIALIZED for 2s [ 1201.214832] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.215038] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.215123] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.215327] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.215430] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.215761] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.215761] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.215761] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.216095] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.216095] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.216095] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2880c629-d8d0-45b5-b939-d99c78caab70 is going to be updated. [ 1201.242347] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.242527] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.242602] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.242801] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.243118] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.251725] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2880c629-d8d0-45b5-b939-d99c78caab70 in Status: IN_PROGRESS for 2s [ 1201.472303] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 in Status: SUCCESS [ 1201.472758] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.473061] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.473360] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.473769] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.474033] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.474191] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.474523] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.475018] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.475018] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38d21e96-89fb-4956-acd8-feb64ddca5d0',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.977280] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('38d21e96-89fb-4956-acd8-feb64ddca5d0',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.479593] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('38d21e96-89fb-4956-acd8-feb64ddca5d0',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.982126] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.982369] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.982369] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.982608] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.982734] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.982858] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 is going to be updated. [ 1203.021676] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.021870] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.021915] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.022131] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.022286] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.038405] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 in Status: IN_PROGRESS for 2s [ 1203.060434] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ec3969d-7444-46cd-8273-33276cfbb49e in Status: SUCCESS [ 1203.060699] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ec3969d-7444-46cd-8273-33276cfbb49e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.060871] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ec3969d-7444-46cd-8273-33276cfbb49e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.061066] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ec3969d-7444-46cd-8273-33276cfbb49e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.061270] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.061389] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.061453] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.061612] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.061695] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.061781] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ec3969d-7444-46cd-8273-33276cfbb49e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.061872] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ec3969d-7444-46cd-8273-33276cfbb49e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.263559] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2880c629-d8d0-45b5-b939-d99c78caab70 in Status: SUCCESS [ 1203.263559] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2880c629-d8d0-45b5-b939-d99c78caab70 deletion is rescheduled due to dependency. [ 1203.263779] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.564485] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ec3969d-7444-46cd-8273-33276cfbb49e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.899453] env[65943]: INFO networking_nsxv3.common.synchronization [req-dd7a6d01-d85b-4ace-a550-6eac8d532448 req-2f543af7-11cc-4f45-8b7e-7be81e50efda tempest-AttachInterfacesUnderV243Test-1627395556 tempest-AttachInterfacesUnderV243Test-1627395556-project-member] Enqueued Resource ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 with Priority: HIGHEST for action security_group_members [ 1203.899888] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 with Priority: HIGHEST for action security_group_members [ 1203.900569] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-38d21e96-89fb-4956-acd8-feb64ddca5d0 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.900668] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.068217] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ec3969d-7444-46cd-8273-33276cfbb49e: rpc.has_security_group_logging(os_id): False [ 1204.086215] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.086466] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.086466] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.086711] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.086820] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.087113] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.087239] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.087375] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.087469] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.087595] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.087690] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ec3969d-7444-46cd-8273-33276cfbb49e is going to be created. [ 1204.157302] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.157551] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.157648] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.158693] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.158882] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.171605] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ec3969d-7444-46cd-8273-33276cfbb49e in Status: IN_PROGRESS for 2s [ 1205.048061] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 in Status: SUCCESS [ 1205.048464] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.048464] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.048646] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.048837] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.048956] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.049044] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.049189] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.049264] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.049342] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.049488] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('38d21e96-89fb-4956-acd8-feb64ddca5d0',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.050965] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.051157] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.051318] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.051423] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.051489] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.051726] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.051814] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.051947] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38d21e96-89fb-4956-acd8-feb64ddca5d0',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.552125] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('38d21e96-89fb-4956-acd8-feb64ddca5d0',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.553774] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.553917] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.553965] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.554230] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.554297] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.554481] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.554575] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.554654] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.554786] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.554856] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.554941] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 is going to be updated. [ 1205.585693] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.585887] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.585978] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.586238] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.586417] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.595476] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 in Status: IN_PROGRESS for 2s [ 1206.055035] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 38d21e96-89fb-4956-acd8-feb64ddca5d0: rpc.has_security_group_logging(os_id): False [ 1206.074062] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.074194] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.074230] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.074508] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.074632] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.074926] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.075083] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.075177] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.075359] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.075461] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.075573] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 is going to be updated. [ 1206.136101] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.136370] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.136370] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.136482] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.136622] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.147102] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 in Status: IN_PROGRESS for 2s [ 1206.197851] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ec3969d-7444-46cd-8273-33276cfbb49e in Status: SUCCESS [ 1206.197961] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ec3969d-7444-46cd-8273-33276cfbb49e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.606303] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 in Status: SUCCESS [ 1207.606614] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 deletion is rescheduled due to dependency. [ 1207.606614] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.606799] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.607058] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.607288] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.607449] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.607560] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.607752] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.607844] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.607943] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38d21e96-89fb-4956-acd8-feb64ddca5d0',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.110968] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.111204] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.111304] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.111596] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.111729] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.112029] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.112187] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.112275] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.112479] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.112593] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.112702] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 is going to be updated. [ 1208.150507] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.150754] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.150754] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.150934] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.151137] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.161981] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 in Status: IN_PROGRESS for 2s [ 1208.170413] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 in Status: SUCCESS [ 1208.170682] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.170885] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.171099] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.171188] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38d21e96-89fb-4956-acd8-feb64ddca5d0',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.700503] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.700503] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.700503] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.701072] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.701072] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.701249] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 is going to be deleted. [ 1208.754667] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.754870] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.754944] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.755208] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.755328] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.755505] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.901660] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1208.901769] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1209.914200] env[65943]: INFO networking_nsxv3.common.synchronization [req-5c3b0b8e-8545-46f2-ab0d-0b45067656aa req-c38dd147-eb9d-4663-be88-df87ab2b9a42 tempest-ServerActionsTestOtherA-92071881 tempest-ServerActionsTestOtherA-92071881-project-member] Enqueued Resource ID: 3e3d8b17-4394-4674-b793-075706514abb with Priority: HIGHEST for action security_group_members [ 1209.915207] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3d8b17-4394-4674-b793-075706514abb with Priority: HIGHEST for action security_group_members [ 1209.915207] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3d8b17-4394-4674-b793-075706514abb taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.915387] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.915449] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.915856] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.916067] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.916184] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.916230] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.916391] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.916471] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.916566] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e3d8b17-4394-4674-b793-075706514abb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.171696] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 in Status: SUCCESS [ 1210.171904] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 deletion is rescheduled due to dependency. [ 1210.172029] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.172188] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.172403] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.172584] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.172699] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.172762] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.172910] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.172988] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.173099] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38d21e96-89fb-4956-acd8-feb64ddca5d0',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.421321] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e3d8b17-4394-4674-b793-075706514abb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.676157] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.676401] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.676401] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.676586] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.676681] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.676903] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.677010] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.677078] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.677234] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.677313] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.677644] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38d21e96-89fb-4956-acd8-feb64ddca5d0 is going to be deleted. [ 1210.712501] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.712712] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.712712] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.712914] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.713016] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.713262] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38d21e96-89fb-4956-acd8-feb64ddca5d0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.888038] env[65943]: INFO networking_nsxv3.common.synchronization [req-306befe8-1d36-4f0f-96fb-1a08374ed9f3 req-2e320459-10b7-42e6-889d-7f946951b063 tempest-ServerActionsTestOtherB-2092325239 tempest-ServerActionsTestOtherB-2092325239-project-member] Enqueued Resource ID: 2880c629-d8d0-45b5-b939-d99c78caab70 with Priority: HIGHEST for action security_group_members [ 1210.888514] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2880c629-d8d0-45b5-b939-d99c78caab70 with Priority: HIGHEST for action security_group_members [ 1210.888817] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2880c629-d8d0-45b5-b939-d99c78caab70 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.888937] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.889048] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.889395] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.889794] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.889794] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.889794] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.890036] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.890098] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.890134] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2880c629-d8d0-45b5-b939-d99c78caab70',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.921849] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e3d8b17-4394-4674-b793-075706514abb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.158986] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-454 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.159288] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-454" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.159418] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-454" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.159942] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-454" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.160335] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.160573] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.160681] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.160929] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.161134] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.161389] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1211.161533] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1211.161667] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1211.161809] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1211.161950] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1211.162090] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1211.162359] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1211.186742] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1211.186907] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1211.187336] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1211.187336] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-454" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.187641] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-9d42a825-1b61-42bb-a185-c70d68cf1aaf taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.187810] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-9d42a825-1b61-42bb-a185-c70d68cf1aaf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.187920] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-9d42a825-1b61-42bb-a185-c70d68cf1aaf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.188264] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-9d42a825-1b61-42bb-a185-c70d68cf1aaf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.188402] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d42a825-1b61-42bb-a185-c70d68cf1aaf',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.392432] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.392620] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.392673] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.392882] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.392974] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.393252] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.393361] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.393361] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.393513] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.393589] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.393677] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2880c629-d8d0-45b5-b939-d99c78caab70 is going to be updated. [ 1211.418886] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.419094] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.419149] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.419330] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.419480] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.423940] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.424091] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.424143] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.424342] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.424412] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.424511] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e3d8b17-4394-4674-b793-075706514abb is going to be updated. [ 1211.428985] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2880c629-d8d0-45b5-b939-d99c78caab70 in Status: IN_PROGRESS for 2s [ 1211.460857] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.461054] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.461054] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.461232] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.461380] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.471523] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3d8b17-4394-4674-b793-075706514abb in Status: IN_PROGRESS for 2s [ 1211.691211] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.691690] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.691690] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.691982] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.692120] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.692327] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port 9d42a825-1b61-42bb-a185-c70d68cf1aaf not found, creating... [ 1211.692526] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.694673] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.694673] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.694673] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.694673] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.694673] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.694673] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.694673] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.694673] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.694673] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.694673] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: 9d42a825-1b61-42bb-a185-c70d68cf1aaf is going to be created. [ 1211.731891] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.732119] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.732387] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.732590] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.732831] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.733073] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-9d42a825-1b61-42bb-a185-c70d68cf1aaf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.267492] env[65943]: INFO networking_nsxv3.common.synchronization [None req-6238cb50-375c-4e95-8649-57914b6e247e None None] Enqueued Resource ID: 37d54e5b-399e-4eff-ba8f-ef078c865863 with Priority: HIGHEST for action port [ 1212.269266] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37d54e5b-399e-4eff-ba8f-ef078c865863 with Priority: HIGHEST for action port [ 1212.269266] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-37d54e5b-399e-4eff-ba8f-ef078c865863 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.269485] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37d54e5b-399e-4eff-ba8f-ef078c865863" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.270875] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37d54e5b-399e-4eff-ba8f-ef078c865863" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.271606] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37d54e5b-399e-4eff-ba8f-ef078c865863" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.271606] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37d54e5b-399e-4eff-ba8f-ef078c865863',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.418730] env[65943]: INFO networking_nsxv3.common.synchronization [req-306befe8-1d36-4f0f-96fb-1a08374ed9f3 req-5ef37e94-53de-46c0-bc23-c111a325b80e service nova] Enqueued Resource ID: 2880c629-d8d0-45b5-b939-d99c78caab70 with Priority: HIGHEST for action security_group_rules [ 1212.418904] env[65943]: INFO networking_nsxv3.common.synchronization [req-306befe8-1d36-4f0f-96fb-1a08374ed9f3 req-5ef37e94-53de-46c0-bc23-c111a325b80e service nova] Enqueued Resource ID: 2880c629-d8d0-45b5-b939-d99c78caab70 with Priority: HIGHEST for action security_group_members [ 1212.419049] env[65943]: INFO networking_nsxv3.common.synchronization [req-306befe8-1d36-4f0f-96fb-1a08374ed9f3 req-5ef37e94-53de-46c0-bc23-c111a325b80e service nova] Enqueued Resource ID: 9d42a825-1b61-42bb-a185-c70d68cf1aaf with Priority: HIGHEST for action port [ 1212.419559] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2880c629-d8d0-45b5-b939-d99c78caab70 with Priority: HIGHEST for action security_group_rules [ 1212.419717] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2880c629-d8d0-45b5-b939-d99c78caab70 with Priority: HIGHEST for action security_group_members [ 1212.419815] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d42a825-1b61-42bb-a185-c70d68cf1aaf with Priority: HIGHEST for action port [ 1212.420179] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2880c629-d8d0-45b5-b939-d99c78caab70 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.420467] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.420467] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.420747] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.420823] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2880c629-d8d0-45b5-b939-d99c78caab70',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.421707] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2880c629-d8d0-45b5-b939-d99c78caab70 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.422609] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.422761] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d42a825-1b61-42bb-a185-c70d68cf1aaf taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.422940] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d42a825-1b61-42bb-a185-c70d68cf1aaf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.423009] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d42a825-1b61-42bb-a185-c70d68cf1aaf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.423220] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d42a825-1b61-42bb-a185-c70d68cf1aaf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.423521] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d42a825-1b61-42bb-a185-c70d68cf1aaf',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.773630] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 37d54e5b-399e-4eff-ba8f-ef078c865863 [ 1212.773920] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.774073] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.774144] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.774346] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.774434] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.774534] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:37d54e5b-399e-4eff-ba8f-ef078c865863 already deleted. [ 1212.774617] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37d54e5b-399e-4eff-ba8f-ef078c865863" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.925320] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2880c629-d8d0-45b5-b939-d99c78caab70 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.925460] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.925624] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9d42a825-1b61-42bb-a185-c70d68cf1aaf with status ACTIVE [ 1212.925787] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.925891] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.925952] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.927367] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.927367] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.927367] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.927367] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.927367] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.927367] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.927367] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.927367] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.927367] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.927367] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.927367] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.927367] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.927731] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9d42a825-1b61-42bb-a185-c70d68cf1aaf is going to be updated. [ 1212.949059] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.949224] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.949320] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.949542] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.949699] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.949814] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d42a825-1b61-42bb-a185-c70d68cf1aaf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.438987] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2880c629-d8d0-45b5-b939-d99c78caab70 in Status: SUCCESS [ 1213.439249] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2880c629-d8d0-45b5-b939-d99c78caab70 deletion is rescheduled due to dependency. [ 1213.439300] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.439454] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.439742] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.439944] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.440178] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.440286] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.440456] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.440568] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.440783] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2880c629-d8d0-45b5-b939-d99c78caab70',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.482338] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3d8b17-4394-4674-b793-075706514abb in Status: SUCCESS [ 1213.482533] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.944531] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2880c629-d8d0-45b5-b939-d99c78caab70',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.052489] env[65943]: INFO networking_nsxv3.common.synchronization [None req-6a44a296-a4bd-4bd8-8afb-a9b92d1937b6 None None] Enqueued Resource ID: bdb10a49-7e26-42b7-a6e4-f58242310c9a with Priority: HIGHEST for action port [ 1214.053072] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdb10a49-7e26-42b7-a6e4-f58242310c9a with Priority: HIGHEST for action port [ 1214.053394] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-bdb10a49-7e26-42b7-a6e4-f58242310c9a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.053749] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bdb10a49-7e26-42b7-a6e4-f58242310c9a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.053749] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bdb10a49-7e26-42b7-a6e4-f58242310c9a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.053848] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bdb10a49-7e26-42b7-a6e4-f58242310c9a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.053921] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdb10a49-7e26-42b7-a6e4-f58242310c9a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.448929] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2880c629-d8d0-45b5-b939-d99c78caab70',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.555622] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bdb10a49-7e26-42b7-a6e4-f58242310c9a [ 1214.555883] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.556028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.556096] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.556316] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.556408] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.556509] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bdb10a49-7e26-42b7-a6e4-f58242310c9a already deleted. [ 1214.556591] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bdb10a49-7e26-42b7-a6e4-f58242310c9a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.951098] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.951280] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.951347] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.951563] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.951654] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.951760] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2880c629-d8d0-45b5-b939-d99c78caab70 is going to be updated. [ 1214.980630] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.980877] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.980947] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.981146] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.981291] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.989780] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2880c629-d8d0-45b5-b939-d99c78caab70 in Status: IN_PROGRESS for 2s [ 1217.001871] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2880c629-d8d0-45b5-b939-d99c78caab70 in Status: SUCCESS [ 1217.002254] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.002359] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.002710] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.003048] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.003210] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.003328] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.003582] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.003721] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.003874] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.004045] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2880c629-d8d0-45b5-b939-d99c78caab70',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.506246] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2880c629-d8d0-45b5-b939-d99c78caab70',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.869159] env[65943]: INFO networking_nsxv3.common.synchronization [req-6fe51933-8aab-414c-a867-a798a8ffc50a req-8fceed45-dbd4-4cf0-a9ca-20e442581014 tempest-ServerAddressesTestJSON-1099235496 tempest-ServerAddressesTestJSON-1099235496-project-member] Enqueued Resource ID: 5e68ec8e-5429-41d7-8e64-cf2efa140ba3 with Priority: HIGHEST for action security_group_members [ 1217.869938] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e68ec8e-5429-41d7-8e64-cf2efa140ba3 with Priority: HIGHEST for action security_group_members [ 1217.870449] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e68ec8e-5429-41d7-8e64-cf2efa140ba3 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.870449] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e68ec8e-5429-41d7-8e64-cf2efa140ba3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.870449] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e68ec8e-5429-41d7-8e64-cf2efa140ba3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.870722] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e68ec8e-5429-41d7-8e64-cf2efa140ba3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.870860] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.870962] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.871033] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.871229] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.871282] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.871360] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e68ec8e-5429-41d7-8e64-cf2efa140ba3',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.009460] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2880c629-d8d0-45b5-b939-d99c78caab70: rpc.has_security_group_logging(os_id): False [ 1218.037196] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.037415] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.037415] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.037734] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.037830] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.038113] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.038219] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.038282] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.038433] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.038509] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.038597] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2880c629-d8d0-45b5-b939-d99c78caab70 is going to be updated. [ 1218.126775] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.126775] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.126775] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.127076] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.127076] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.147638] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2880c629-d8d0-45b5-b939-d99c78caab70 in Status: IN_PROGRESS for 2s [ 1218.170938] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-365 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.171152] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-365" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.171275] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-365" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.171591] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-365" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.171846] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.171999] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.172273] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.172494] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.172646] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.172856] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1218.172967] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1218.173158] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1218.173220] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1218.173290] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1218.173393] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1218.173522] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1218.193049] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1218.193225] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1218.193419] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1218.193535] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-365" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.193845] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-fb1d34d2-d375-4e8a-adbc-bccce175264f taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.194026] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-fb1d34d2-d375-4e8a-adbc-bccce175264f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.194147] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-fb1d34d2-d375-4e8a-adbc-bccce175264f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.194457] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-fb1d34d2-d375-4e8a-adbc-bccce175264f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.194590] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb1d34d2-d375-4e8a-adbc-bccce175264f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.373357] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.373599] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.373599] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.373781] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.373875] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.374085] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.374182] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.374238] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.374391] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.374463] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.374545] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e68ec8e-5429-41d7-8e64-cf2efa140ba3 already deleted. [ 1218.374625] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e68ec8e-5429-41d7-8e64-cf2efa140ba3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.696579] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.696787] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.698051] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.698051] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.698051] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.698051] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port fb1d34d2-d375-4e8a-adbc-bccce175264f not found, creating... [ 1218.698051] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.698051] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.698051] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.698405] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.698405] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.698646] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.698846] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.698911] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.699184] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.699322] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.699459] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: fb1d34d2-d375-4e8a-adbc-bccce175264f is going to be created. [ 1218.724373] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.724373] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.724373] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.724667] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.724667] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.724888] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-fb1d34d2-d375-4e8a-adbc-bccce175264f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.440962] env[65943]: INFO networking_nsxv3.common.synchronization [req-6fe51933-8aab-414c-a867-a798a8ffc50a req-674191e2-b62c-499c-a14e-94ad0b824914 service nova] Enqueued Resource ID: 5e68ec8e-5429-41d7-8e64-cf2efa140ba3 with Priority: HIGHEST for action security_group_rules [ 1219.441546] env[65943]: INFO networking_nsxv3.common.synchronization [req-6fe51933-8aab-414c-a867-a798a8ffc50a req-674191e2-b62c-499c-a14e-94ad0b824914 service nova] Enqueued Resource ID: 5e68ec8e-5429-41d7-8e64-cf2efa140ba3 with Priority: HIGHEST for action security_group_members [ 1219.441654] env[65943]: INFO networking_nsxv3.common.synchronization [req-6fe51933-8aab-414c-a867-a798a8ffc50a req-674191e2-b62c-499c-a14e-94ad0b824914 service nova] Enqueued Resource ID: fb1d34d2-d375-4e8a-adbc-bccce175264f with Priority: HIGHEST for action port [ 1219.442702] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e68ec8e-5429-41d7-8e64-cf2efa140ba3 with Priority: HIGHEST for action security_group_rules [ 1219.443579] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e68ec8e-5429-41d7-8e64-cf2efa140ba3 with Priority: HIGHEST for action security_group_members [ 1219.443579] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb1d34d2-d375-4e8a-adbc-bccce175264f with Priority: HIGHEST for action port [ 1219.443579] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e68ec8e-5429-41d7-8e64-cf2efa140ba3 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.443935] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e68ec8e-5429-41d7-8e64-cf2efa140ba3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.443935] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e68ec8e-5429-41d7-8e64-cf2efa140ba3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.444378] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e68ec8e-5429-41d7-8e64-cf2efa140ba3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.444631] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e68ec8e-5429-41d7-8e64-cf2efa140ba3',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.447509] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e68ec8e-5429-41d7-8e64-cf2efa140ba3 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.447673] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e68ec8e-5429-41d7-8e64-cf2efa140ba3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.447673] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e68ec8e-5429-41d7-8e64-cf2efa140ba3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.448588] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e68ec8e-5429-41d7-8e64-cf2efa140ba3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.448588] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.448588] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.448588] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.448848] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.448848] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.448848] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e68ec8e-5429-41d7-8e64-cf2efa140ba3',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.450044] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb1d34d2-d375-4e8a-adbc-bccce175264f taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.450044] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb1d34d2-d375-4e8a-adbc-bccce175264f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.453068] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb1d34d2-d375-4e8a-adbc-bccce175264f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.453068] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb1d34d2-d375-4e8a-adbc-bccce175264f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.453068] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb1d34d2-d375-4e8a-adbc-bccce175264f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.953135] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fb1d34d2-d375-4e8a-adbc-bccce175264f with status ACTIVE [ 1219.953385] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.953521] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.953589] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.953814] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.953997] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.954154] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.954252] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.954310] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.954465] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.954541] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.954726] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.954820] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.954879] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.955017] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.955086] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.955173] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fb1d34d2-d375-4e8a-adbc-bccce175264f is going to be updated. [ 1219.956310] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e68ec8e-5429-41d7-8e64-cf2efa140ba3 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.956405] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e68ec8e-5429-41d7-8e64-cf2efa140ba3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.956563] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e68ec8e-5429-41d7-8e64-cf2efa140ba3',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.983810] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.984063] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.984063] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.984383] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.984383] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.984520] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb1d34d2-d375-4e8a-adbc-bccce175264f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.163136] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2880c629-d8d0-45b5-b939-d99c78caab70 in Status: SUCCESS [ 1220.163326] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.460296] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e68ec8e-5429-41d7-8e64-cf2efa140ba3',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.963433] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.963663] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.963711] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.963934] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.964149] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.964316] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e68ec8e-5429-41d7-8e64-cf2efa140ba3 is going to be created. [ 1220.987863] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.988039] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.988163] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.988368] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.988491] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.997190] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e68ec8e-5429-41d7-8e64-cf2efa140ba3 in Status: UNINITIALIZED for 2s [ 1223.008810] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e68ec8e-5429-41d7-8e64-cf2efa140ba3 in Status: SUCCESS [ 1223.009182] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e68ec8e-5429-41d7-8e64-cf2efa140ba3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.009182] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e68ec8e-5429-41d7-8e64-cf2efa140ba3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.009363] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e68ec8e-5429-41d7-8e64-cf2efa140ba3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.009557] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.009715] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.009774] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.009933] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.010027] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.010116] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e68ec8e-5429-41d7-8e64-cf2efa140ba3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.010207] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e68ec8e-5429-41d7-8e64-cf2efa140ba3',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.512500] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e68ec8e-5429-41d7-8e64-cf2efa140ba3 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.512686] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e68ec8e-5429-41d7-8e64-cf2efa140ba3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.512733] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e68ec8e-5429-41d7-8e64-cf2efa140ba3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.512943] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e68ec8e-5429-41d7-8e64-cf2efa140ba3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.513170] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.513341] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.513341] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.513416] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.513512] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.513596] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e68ec8e-5429-41d7-8e64-cf2efa140ba3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.513746] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e68ec8e-5429-41d7-8e64-cf2efa140ba3 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.513839] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e68ec8e-5429-41d7-8e64-cf2efa140ba3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.513907] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e68ec8e-5429-41d7-8e64-cf2efa140ba3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.514101] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e68ec8e-5429-41d7-8e64-cf2efa140ba3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.514285] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.514411] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.514471] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.514612] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.514712] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.514801] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e68ec8e-5429-41d7-8e64-cf2efa140ba3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.514888] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e68ec8e-5429-41d7-8e64-cf2efa140ba3',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.018086] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e68ec8e-5429-41d7-8e64-cf2efa140ba3: rpc.has_security_group_logging(os_id): False [ 1224.037869] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.038106] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.038106] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.038310] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.038404] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.038600] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.038711] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.038767] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.038895] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.038975] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.039185] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.039278] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.039337] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.039474] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.039549] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.039827] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.039984] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.039984] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.040125] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.040196] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.040281] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e68ec8e-5429-41d7-8e64-cf2efa140ba3 is going to be created. [ 1224.101188] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.101396] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.101396] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.101847] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.101847] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.111367] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e68ec8e-5429-41d7-8e64-cf2efa140ba3 in Status: IN_PROGRESS for 2s [ 1224.444499] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1224.444777] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1226.124602] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e68ec8e-5429-41d7-8e64-cf2efa140ba3 in Status: SUCCESS [ 1226.124959] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e68ec8e-5429-41d7-8e64-cf2efa140ba3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.986417] env[65943]: INFO networking_nsxv3.common.synchronization [req-e6b0f530-c326-4c3d-b620-3694fc0e83fd req-d077d2e6-f82d-44c0-b12b-17a7603b75e4 tempest-ServerActionsTestOtherA-92071881 tempest-ServerActionsTestOtherA-92071881-project-member] Enqueued Resource ID: 3e3d8b17-4394-4674-b793-075706514abb with Priority: HIGHEST for action security_group_members [ 1226.986978] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3d8b17-4394-4674-b793-075706514abb with Priority: HIGHEST for action security_group_members [ 1226.987334] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3d8b17-4394-4674-b793-075706514abb taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.987458] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.987526] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.987730] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.987895] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.987996] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.988198] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.988370] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.988463] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.988555] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e3d8b17-4394-4674-b793-075706514abb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.490761] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.491157] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.491157] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.491232] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.491294] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.491497] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.491596] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.491660] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.491810] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.491887] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.491976] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e3d8b17-4394-4674-b793-075706514abb is going to be updated. [ 1227.521693] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.521892] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.521941] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.522173] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.522350] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.532547] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3d8b17-4394-4674-b793-075706514abb in Status: IN_PROGRESS for 2s [ 1229.545411] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3d8b17-4394-4674-b793-075706514abb in Status: SUCCESS [ 1229.546159] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e3d8b17-4394-4674-b793-075706514abb deletion is rescheduled due to dependency. [ 1229.546159] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3d8b17-4394-4674-b793-075706514abb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.142749] env[65943]: INFO networking_nsxv3.common.synchronization [req-6ec7e98b-6b5a-4be8-b3e8-d0932c9bd13d req-dcbc982d-704f-429b-a29f-7a50ec642420 tempest-ServerAddressesTestJSON-1099235496 tempest-ServerAddressesTestJSON-1099235496-project-member] Enqueued Resource ID: 5e68ec8e-5429-41d7-8e64-cf2efa140ba3 with Priority: HIGHEST for action security_group_members [ 1230.143309] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e68ec8e-5429-41d7-8e64-cf2efa140ba3 with Priority: HIGHEST for action security_group_members [ 1230.143622] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e68ec8e-5429-41d7-8e64-cf2efa140ba3 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.143866] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e68ec8e-5429-41d7-8e64-cf2efa140ba3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.143866] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e68ec8e-5429-41d7-8e64-cf2efa140ba3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.143987] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e68ec8e-5429-41d7-8e64-cf2efa140ba3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.144149] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.144376] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.144376] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.144472] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.144537] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.144633] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e68ec8e-5429-41d7-8e64-cf2efa140ba3',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.646959] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.647366] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.647366] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.647485] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.647591] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.647806] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.647900] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.647962] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.648131] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.648208] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.648295] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e68ec8e-5429-41d7-8e64-cf2efa140ba3 is going to be updated. [ 1230.677618] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.677826] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.677826] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.678035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.678169] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.686687] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e68ec8e-5429-41d7-8e64-cf2efa140ba3 in Status: IN_PROGRESS for 2s [ 1232.275772] env[65943]: INFO networking_nsxv3.common.synchronization [req-642ed9c8-9a0c-462e-8bef-5e81e3da5371 req-60f147f1-c516-4ed6-b7e2-1c3d24de4b34 tempest-ServerActionsTestJSON-1587559204 tempest-ServerActionsTestJSON-1587559204-project-member] Enqueued Resource ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 with Priority: HIGHEST for action security_group_members [ 1232.276368] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 with Priority: HIGHEST for action security_group_members [ 1232.276689] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bcdadce-edf2-43d0-a8d9-43033bb27e63 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.276815] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.276885] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.277122] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.277356] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.277471] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.277534] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.277691] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.277780] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.277871] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bcdadce-edf2-43d0-a8d9-43033bb27e63',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.698156] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e68ec8e-5429-41d7-8e64-cf2efa140ba3 in Status: SUCCESS [ 1232.698380] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e68ec8e-5429-41d7-8e64-cf2efa140ba3 deletion is rescheduled due to dependency. [ 1232.698546] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e68ec8e-5429-41d7-8e64-cf2efa140ba3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.782888] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.782888] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.782888] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.782888] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.782888] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.782888] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.782888] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.782888] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.782888] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.782888] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.782888] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 is going to be updated. [ 1232.811022] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.811022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.811022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.811022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.811022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.820948] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 in Status: IN_PROGRESS for 2s [ 1234.832460] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 in Status: SUCCESS [ 1234.832808] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 deletion is rescheduled due to dependency. [ 1234.832808] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.026388] env[65943]: INFO networking_nsxv3.common.synchronization [None req-624d87e6-22e5-4bfa-b5e7-a8d2c792c52a None None] Enqueued Resource ID: fc24ff84-3261-4c25-a631-c036af127e2e with Priority: HIGHEST for action port [ 1236.026939] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc24ff84-3261-4c25-a631-c036af127e2e with Priority: HIGHEST for action port [ 1236.027255] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc24ff84-3261-4c25-a631-c036af127e2e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.027376] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc24ff84-3261-4c25-a631-c036af127e2e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.027442] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc24ff84-3261-4c25-a631-c036af127e2e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.027690] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc24ff84-3261-4c25-a631-c036af127e2e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.027771] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc24ff84-3261-4c25-a631-c036af127e2e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.530306] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc24ff84-3261-4c25-a631-c036af127e2e [ 1236.530501] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.530634] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.530703] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.531292] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.531292] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.531292] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc24ff84-3261-4c25-a631-c036af127e2e already deleted. [ 1236.531292] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc24ff84-3261-4c25-a631-c036af127e2e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.174666] env[65943]: INFO networking_nsxv3.common.synchronization [None req-ae821edf-dcd1-40d0-b927-30ae088ae568 None None] Enqueued Resource ID: d59156a9-d980-4279-a1b3-065c8e55e018 with Priority: HIGHEST for action port [ 1238.175250] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d59156a9-d980-4279-a1b3-065c8e55e018 with Priority: HIGHEST for action port [ 1238.175558] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-d59156a9-d980-4279-a1b3-065c8e55e018 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.175686] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d59156a9-d980-4279-a1b3-065c8e55e018" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.175758] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d59156a9-d980-4279-a1b3-065c8e55e018" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.176012] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d59156a9-d980-4279-a1b3-065c8e55e018" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.176147] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d59156a9-d980-4279-a1b3-065c8e55e018',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.678480] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d59156a9-d980-4279-a1b3-065c8e55e018 [ 1238.678709] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.678838] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.678924] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.679133] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.679227] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.679326] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d59156a9-d980-4279-a1b3-065c8e55e018 already deleted. [ 1238.679407] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d59156a9-d980-4279-a1b3-065c8e55e018" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.657730] env[65943]: INFO networking_nsxv3.common.synchronization [None req-da62783c-bcf2-410f-825e-56d437dbe873 None None] Enqueued Resource ID: d796e98f-13b1-477d-82e0-b135cd41e7c3 with Priority: HIGHEST for action port [ 1240.658460] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d796e98f-13b1-477d-82e0-b135cd41e7c3 with Priority: HIGHEST for action port [ 1240.658794] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-d796e98f-13b1-477d-82e0-b135cd41e7c3 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.658913] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d796e98f-13b1-477d-82e0-b135cd41e7c3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.658979] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d796e98f-13b1-477d-82e0-b135cd41e7c3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.659269] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d796e98f-13b1-477d-82e0-b135cd41e7c3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.659357] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d796e98f-13b1-477d-82e0-b135cd41e7c3',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.163923] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d796e98f-13b1-477d-82e0-b135cd41e7c3 [ 1241.164176] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.164357] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.164434] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.164592] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.164687] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.164776] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d796e98f-13b1-477d-82e0-b135cd41e7c3 already deleted. [ 1241.164853] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d796e98f-13b1-477d-82e0-b135cd41e7c3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.470433] env[65943]: INFO networking_nsxv3.common.synchronization [req-ed0c413e-571c-4e91-8db9-a0b73fea6eb4 req-b9d3a553-f4d8-4b83-ab2c-8bcf10995811 tempest-ServersTestJSON-746248001 tempest-ServersTestJSON-746248001-project-member] Enqueued Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1241.470865] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1241.471229] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.471354] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.471460] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.471725] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.471888] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.471988] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.472089] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.472232] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.472342] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.472440] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.830332] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-928 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.830332] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-928" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.830332] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-928" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.830766] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-928" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.830866] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.831041] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.831164] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.831389] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.831536] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.831747] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1241.831857] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1241.831964] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1241.832418] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1241.832418] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1241.832418] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1241.832418] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1241.853013] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1241.853207] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1241.853331] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1241.853505] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-928" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.853814] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-8ac74db1-cca3-4e2d-ae23-aa5cc088f9fe taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.854015] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-8ac74db1-cca3-4e2d-ae23-aa5cc088f9fe" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.854729] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-8ac74db1-cca3-4e2d-ae23-aa5cc088f9fe" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.854729] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-8ac74db1-cca3-4e2d-ae23-aa5cc088f9fe" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.854729] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ac74db1-cca3-4e2d-ae23-aa5cc088f9fe',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.975064] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.975064] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.975064] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.975321] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.975321] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.975495] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.975591] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.975652] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.975798] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.975874] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.975957] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1a36d99-a044-4987-8943-d83852cf66f8 already deleted. [ 1241.976049] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.357034] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.357295] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.357418] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.357904] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.358151] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.358320] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port 8ac74db1-cca3-4e2d-ae23-aa5cc088f9fe not found, creating... [ 1242.358604] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.358768] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.358886] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.359135] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.359283] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.359574] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.360235] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.360400] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.360634] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.360944] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.361173] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: 8ac74db1-cca3-4e2d-ae23-aa5cc088f9fe is going to be created. [ 1242.381066] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.381289] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.381411] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.381667] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.381895] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.382154] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-8ac74db1-cca3-4e2d-ae23-aa5cc088f9fe" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.429024] env[65943]: INFO networking_nsxv3.common.synchronization [None req-93484c66-5fbd-4cd4-aafc-177f0d57a7b6 None None] Enqueued Resource ID: 30bee53c-8f16-400e-b3f8-3f348ec718d9 with Priority: HIGHEST for action port [ 1242.429024] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30bee53c-8f16-400e-b3f8-3f348ec718d9 with Priority: HIGHEST for action port [ 1242.429024] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-30bee53c-8f16-400e-b3f8-3f348ec718d9 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.429024] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30bee53c-8f16-400e-b3f8-3f348ec718d9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.429024] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30bee53c-8f16-400e-b3f8-3f348ec718d9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.429328] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30bee53c-8f16-400e-b3f8-3f348ec718d9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.429328] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30bee53c-8f16-400e-b3f8-3f348ec718d9',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.931048] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 30bee53c-8f16-400e-b3f8-3f348ec718d9 [ 1242.931305] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.931430] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.931498] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.931708] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.931800] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.931898] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:30bee53c-8f16-400e-b3f8-3f348ec718d9 already deleted. [ 1242.931980] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30bee53c-8f16-400e-b3f8-3f348ec718d9" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.076832] env[65943]: INFO networking_nsxv3.common.synchronization [req-ed0c413e-571c-4e91-8db9-a0b73fea6eb4 req-c5ecb80a-b226-4bf9-8a31-71beecb157dc service nova] Enqueued Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_rules [ 1243.077043] env[65943]: INFO networking_nsxv3.common.synchronization [req-ed0c413e-571c-4e91-8db9-a0b73fea6eb4 req-c5ecb80a-b226-4bf9-8a31-71beecb157dc service nova] Enqueued Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1243.077188] env[65943]: INFO networking_nsxv3.common.synchronization [req-ed0c413e-571c-4e91-8db9-a0b73fea6eb4 req-c5ecb80a-b226-4bf9-8a31-71beecb157dc service nova] Enqueued Resource ID: 8ac74db1-cca3-4e2d-ae23-aa5cc088f9fe with Priority: HIGHEST for action port [ 1243.077696] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_rules [ 1243.077845] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1243.077977] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ac74db1-cca3-4e2d-ae23-aa5cc088f9fe with Priority: HIGHEST for action port [ 1243.078284] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.078570] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.078570] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.078829] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.078915] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.080138] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.080251] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.080332] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.081134] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.081308] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.081420] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.081486] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.081655] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.081745] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.081842] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.082840] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ac74db1-cca3-4e2d-ae23-aa5cc088f9fe taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.083146] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ac74db1-cca3-4e2d-ae23-aa5cc088f9fe" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.083146] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ac74db1-cca3-4e2d-ae23-aa5cc088f9fe" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.083259] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ac74db1-cca3-4e2d-ae23-aa5cc088f9fe" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.083259] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ac74db1-cca3-4e2d-ae23-aa5cc088f9fe',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.585765] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.585959] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.586245] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.588055] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8ac74db1-cca3-4e2d-ae23-aa5cc088f9fe with status ACTIVE [ 1243.588199] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.588332] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.588449] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.588618] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.588678] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.588958] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.589040] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.589144] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.589269] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.589350] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.589538] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.589631] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.589685] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.589839] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.589915] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.590042] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8ac74db1-cca3-4e2d-ae23-aa5cc088f9fe is going to be updated. [ 1243.615259] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.615456] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.615456] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.615654] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.615793] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.615954] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ac74db1-cca3-4e2d-ae23-aa5cc088f9fe" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.093129] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.597618] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.597894] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.597975] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.598207] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.598308] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.598527] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1a36d99-a044-4987-8943-d83852cf66f8 is going to be created. [ 1244.628505] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.628717] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.628717] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.629600] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.629600] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.639396] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: UNINITIALIZED for 2s [ 1245.841909] env[65943]: INFO networking_nsxv3.common.synchronization [req-2818f02d-9108-45d8-b86d-c8b3eeee8f6c req-601a3324-ca8b-4f5e-acfd-39844b74b197 tempest-ServerAddressesNegativeTestJSON-866517100 tempest-ServerAddressesNegativeTestJSON-866517100-project-member] Enqueued Resource ID: 8e1ee83a-4e53-4ab5-84ab-943caf201c5f with Priority: HIGHEST for action security_group_members [ 1245.842467] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e1ee83a-4e53-4ab5-84ab-943caf201c5f with Priority: HIGHEST for action security_group_members [ 1245.842776] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e1ee83a-4e53-4ab5-84ab-943caf201c5f taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.842893] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e1ee83a-4e53-4ab5-84ab-943caf201c5f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.842950] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e1ee83a-4e53-4ab5-84ab-943caf201c5f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.843225] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e1ee83a-4e53-4ab5-84ab-943caf201c5f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.843387] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.843487] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.843565] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.843689] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.843770] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.843859] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e1ee83a-4e53-4ab5-84ab-943caf201c5f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.109560] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-158 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.109806] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-158" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.109943] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-158" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.110323] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-158" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.110653] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.110726] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.110894] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.111189] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.111341] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.111560] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1246.111739] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1246.111813] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1246.111872] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1246.111979] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1246.112117] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1246.112237] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1246.137083] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1246.137270] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1246.137410] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1246.137593] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-158" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.137904] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-eaf393cd-bcb9-4cb5-8f86-048cfa46862a taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.138091] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-eaf393cd-bcb9-4cb5-8f86-048cfa46862a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.138212] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-eaf393cd-bcb9-4cb5-8f86-048cfa46862a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.138542] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-eaf393cd-bcb9-4cb5-8f86-048cfa46862a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.138703] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eaf393cd-bcb9-4cb5-8f86-048cfa46862a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.346690] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.346690] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.346690] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.347018] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.347018] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.347088] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.347179] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.347254] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.347402] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.347478] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.347564] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e1ee83a-4e53-4ab5-84ab-943caf201c5f already deleted. [ 1246.347642] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e1ee83a-4e53-4ab5-84ab-943caf201c5f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.641219] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.641478] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.641524] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.641762] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.641914] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.642079] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port eaf393cd-bcb9-4cb5-8f86-048cfa46862a not found, creating... [ 1246.642336] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.642493] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.642685] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.642833] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.642972] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.643267] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.643421] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.643535] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.643735] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.643906] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.644075] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: eaf393cd-bcb9-4cb5-8f86-048cfa46862a is going to be created. [ 1246.661335] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: SUCCESS [ 1246.661571] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.661740] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.661970] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.662207] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.662333] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.662400] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.662561] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.662642] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.662728] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.662844] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.669862] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.670120] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.670246] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.670509] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.670741] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.670974] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-eaf393cd-bcb9-4cb5-8f86-048cfa46862a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.063180] env[65943]: INFO networking_nsxv3.common.synchronization [req-34153307-2368-4238-b9b0-0bad8c2a5acc req-d5015c1d-dfa9-46a0-a654-cba55a772a8f tempest-AttachVolumeTestJSON-1035762737 tempest-AttachVolumeTestJSON-1035762737-project-member] Enqueued Resource ID: a3785ccf-0b13-4a67-ba63-81d28e609f6b with Priority: HIGHEST for action security_group_members [ 1247.064019] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3785ccf-0b13-4a67-ba63-81d28e609f6b with Priority: HIGHEST for action security_group_members [ 1247.064228] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3785ccf-0b13-4a67-ba63-81d28e609f6b taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.064228] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3785ccf-0b13-4a67-ba63-81d28e609f6b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.064316] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3785ccf-0b13-4a67-ba63-81d28e609f6b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.065157] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3785ccf-0b13-4a67-ba63-81d28e609f6b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.065157] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.065157] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.065157] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.065157] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.065157] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.065388] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3785ccf-0b13-4a67-ba63-81d28e609f6b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.169064] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.169064] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.169064] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.169064] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.169064] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.169064] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.169064] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.169064] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.169064] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.169064] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.169064] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.169064] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.169064] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.169064] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.169064] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.169064] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.169721] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.169721] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.169721] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.169721] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.169721] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.427403] env[65943]: INFO networking_nsxv3.common.synchronization [req-2818f02d-9108-45d8-b86d-c8b3eeee8f6c req-bc93fd77-8b38-4e55-82cf-19e3e3915309 service nova] Enqueued Resource ID: 8e1ee83a-4e53-4ab5-84ab-943caf201c5f with Priority: HIGHEST for action security_group_rules [ 1247.427583] env[65943]: INFO networking_nsxv3.common.synchronization [req-2818f02d-9108-45d8-b86d-c8b3eeee8f6c req-bc93fd77-8b38-4e55-82cf-19e3e3915309 service nova] Enqueued Resource ID: 8e1ee83a-4e53-4ab5-84ab-943caf201c5f with Priority: HIGHEST for action security_group_members [ 1247.427744] env[65943]: INFO networking_nsxv3.common.synchronization [req-2818f02d-9108-45d8-b86d-c8b3eeee8f6c req-bc93fd77-8b38-4e55-82cf-19e3e3915309 service nova] Enqueued Resource ID: eaf393cd-bcb9-4cb5-8f86-048cfa46862a with Priority: HIGHEST for action port [ 1247.428334] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e1ee83a-4e53-4ab5-84ab-943caf201c5f with Priority: HIGHEST for action security_group_rules [ 1247.428505] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e1ee83a-4e53-4ab5-84ab-943caf201c5f with Priority: HIGHEST for action security_group_members [ 1247.428570] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaf393cd-bcb9-4cb5-8f86-048cfa46862a with Priority: HIGHEST for action port [ 1247.428854] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e1ee83a-4e53-4ab5-84ab-943caf201c5f taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.428965] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e1ee83a-4e53-4ab5-84ab-943caf201c5f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.429059] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e1ee83a-4e53-4ab5-84ab-943caf201c5f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.429326] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e1ee83a-4e53-4ab5-84ab-943caf201c5f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.429412] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e1ee83a-4e53-4ab5-84ab-943caf201c5f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.430545] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e1ee83a-4e53-4ab5-84ab-943caf201c5f taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.430613] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e1ee83a-4e53-4ab5-84ab-943caf201c5f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.430613] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e1ee83a-4e53-4ab5-84ab-943caf201c5f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.430808] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e1ee83a-4e53-4ab5-84ab-943caf201c5f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.430979] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.431089] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.431150] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.431296] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.431381] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.432503] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e1ee83a-4e53-4ab5-84ab-943caf201c5f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.432503] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-eaf393cd-bcb9-4cb5-8f86-048cfa46862a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.432503] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eaf393cd-bcb9-4cb5-8f86-048cfa46862a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.433069] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eaf393cd-bcb9-4cb5-8f86-048cfa46862a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.433069] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eaf393cd-bcb9-4cb5-8f86-048cfa46862a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.433069] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eaf393cd-bcb9-4cb5-8f86-048cfa46862a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.567621] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.568784] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.568784] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.568936] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.569066] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.569237] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.569381] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.569481] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.569629] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.569762] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.569901] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3785ccf-0b13-4a67-ba63-81d28e609f6b is going to be updated. [ 1247.601674] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.601874] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.601874] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.602115] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.602255] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.612795] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3785ccf-0b13-4a67-ba63-81d28e609f6b in Status: IN_PROGRESS for 2s [ 1247.671455] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b1a36d99-a044-4987-8943-d83852cf66f8: rpc.has_security_group_logging(os_id): False [ 1247.698937] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.699213] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.699213] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.700151] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.700151] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.700151] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.700151] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.700151] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.700344] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.700344] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.700503] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.700591] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.700643] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.700876] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.700971] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.701183] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.701275] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.701329] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.701471] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.701546] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.701631] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1a36d99-a044-4987-8943-d83852cf66f8 is going to be created. [ 1247.788149] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.788301] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.788301] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.788573] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.788745] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.804427] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: IN_PROGRESS for 2s [ 1247.935498] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e1ee83a-4e53-4ab5-84ab-943caf201c5f taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.935679] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e1ee83a-4e53-4ab5-84ab-943caf201c5f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.935933] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8e1ee83a-4e53-4ab5-84ab-943caf201c5f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.936904] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eaf393cd-bcb9-4cb5-8f86-048cfa46862a with status ACTIVE [ 1247.937153] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.937322] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.937435] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.937698] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.937849] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.938106] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.938259] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.938366] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.938581] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.938706] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.938984] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.939152] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.939258] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.939460] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.939580] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.939712] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eaf393cd-bcb9-4cb5-8f86-048cfa46862a is going to be updated. [ 1247.977730] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.977954] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.978050] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.978348] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.978562] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.978804] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eaf393cd-bcb9-4cb5-8f86-048cfa46862a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.442032] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8e1ee83a-4e53-4ab5-84ab-943caf201c5f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.947356] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.947520] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.947587] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.948630] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.948630] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.948630] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e1ee83a-4e53-4ab5-84ab-943caf201c5f is going to be created. [ 1248.972266] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.972463] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.972463] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.972681] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.972844] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.983816] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e1ee83a-4e53-4ab5-84ab-943caf201c5f in Status: UNINITIALIZED for 2s [ 1249.625151] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3785ccf-0b13-4a67-ba63-81d28e609f6b in Status: SUCCESS [ 1249.625682] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3785ccf-0b13-4a67-ba63-81d28e609f6b deletion is rescheduled due to dependency. [ 1249.625682] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3785ccf-0b13-4a67-ba63-81d28e609f6b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.866527] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: SUCCESS [ 1249.866792] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.993952] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e1ee83a-4e53-4ab5-84ab-943caf201c5f in Status: SUCCESS [ 1250.994259] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e1ee83a-4e53-4ab5-84ab-943caf201c5f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.994375] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e1ee83a-4e53-4ab5-84ab-943caf201c5f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.994671] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e1ee83a-4e53-4ab5-84ab-943caf201c5f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.994893] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.995019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.995087] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.995251] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.995351] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.995417] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e1ee83a-4e53-4ab5-84ab-943caf201c5f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.995508] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8e1ee83a-4e53-4ab5-84ab-943caf201c5f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.498715] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e1ee83a-4e53-4ab5-84ab-943caf201c5f taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.498967] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e1ee83a-4e53-4ab5-84ab-943caf201c5f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.499104] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e1ee83a-4e53-4ab5-84ab-943caf201c5f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.499437] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e1ee83a-4e53-4ab5-84ab-943caf201c5f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.499692] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.499872] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.499982] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.500304] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.500456] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.500596] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e1ee83a-4e53-4ab5-84ab-943caf201c5f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.500866] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e1ee83a-4e53-4ab5-84ab-943caf201c5f taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.501037] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e1ee83a-4e53-4ab5-84ab-943caf201c5f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.501156] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e1ee83a-4e53-4ab5-84ab-943caf201c5f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.501399] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e1ee83a-4e53-4ab5-84ab-943caf201c5f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.501681] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.501862] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.501972] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.502216] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.502343] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.502485] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e1ee83a-4e53-4ab5-84ab-943caf201c5f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.502643] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8e1ee83a-4e53-4ab5-84ab-943caf201c5f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.006283] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8e1ee83a-4e53-4ab5-84ab-943caf201c5f: rpc.has_security_group_logging(os_id): False [ 1252.026269] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.026269] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.026269] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.026613] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.026613] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.026752] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.026861] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.026930] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.027096] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.027173] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.027375] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.027469] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.027528] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.027666] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.027760] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.027953] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.028062] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.028226] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.028490] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.028490] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.028490] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e1ee83a-4e53-4ab5-84ab-943caf201c5f is going to be created. [ 1252.109534] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.109738] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.109807] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.110059] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.110249] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.139693] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e1ee83a-4e53-4ab5-84ab-943caf201c5f in Status: IN_PROGRESS for 2s [ 1252.293905] env[65943]: INFO networking_nsxv3.common.synchronization [None req-ac9687a4-eb31-4d75-812f-53de18100431 tempest-AttachVolumeTestJSON-1035762737 tempest-AttachVolumeTestJSON-1035762737-project-member] Enqueued Resource ID: 036b36e3-f557-44a3-a77b-61a8567a6143 with Priority: HIGHEST for action security_group_rules [ 1252.293905] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 036b36e3-f557-44a3-a77b-61a8567a6143 with Priority: HIGHEST for action security_group_rules [ 1252.293905] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-036b36e3-f557-44a3-a77b-61a8567a6143 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.293905] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-036b36e3-f557-44a3-a77b-61a8567a6143" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.293905] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-036b36e3-f557-44a3-a77b-61a8567a6143" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.293905] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-036b36e3-f557-44a3-a77b-61a8567a6143" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.293905] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('036b36e3-f557-44a3-a77b-61a8567a6143',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.386683] env[65943]: INFO networking_nsxv3.common.synchronization [None req-55b2d941-1afb-47e9-98e1-ab37f1327131 tempest-AttachVolumeTestJSON-1035762737 tempest-AttachVolumeTestJSON-1035762737-project-member] Enqueued Resource ID: 036b36e3-f557-44a3-a77b-61a8567a6143 with Priority: HIGHEST for action security_group_rules [ 1252.387167] env[65943]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1252.387415] env[65943]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] NSXv3 Agent Agent loop - iteration:3 started [ 1252.388141] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 036b36e3-f557-44a3-a77b-61a8567a6143 with Priority: HIGHEST for action security_group_rules [ 1252.388626] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-036b36e3-f557-44a3-a77b-61a8567a6143 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.388801] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-036b36e3-f557-44a3-a77b-61a8567a6143" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.815298] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.815298] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.815298] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.816307] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.816307] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.816307] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 036b36e3-f557-44a3-a77b-61a8567a6143 already deleted. [ 1252.816307] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-036b36e3-f557-44a3-a77b-61a8567a6143" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.816307] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-036b36e3-f557-44a3-a77b-61a8567a6143" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.816307] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-036b36e3-f557-44a3-a77b-61a8567a6143" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.816307] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('036b36e3-f557-44a3-a77b-61a8567a6143',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.339178] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.339587] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.339587] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.339587] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.339691] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.339809] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 036b36e3-f557-44a3-a77b-61a8567a6143 already deleted. [ 1253.339929] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-036b36e3-f557-44a3-a77b-61a8567a6143" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.136585] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e1ee83a-4e53-4ab5-84ab-943caf201c5f in Status: SUCCESS [ 1254.136846] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e1ee83a-4e53-4ab5-84ab-943caf201c5f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.719823] env[65943]: INFO networking_nsxv3.common.synchronization [None req-f0583564-9ab9-4783-852c-0741790524cc tempest-AttachVolumeNegativeTest-962354070 tempest-AttachVolumeNegativeTest-962354070-project-member] Enqueued Resource ID: 915457aa-a06c-4d08-af98-1cbce6ae4112 with Priority: HIGHEST for action security_group_rules [ 1256.720604] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 915457aa-a06c-4d08-af98-1cbce6ae4112 with Priority: HIGHEST for action security_group_rules [ 1256.721014] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-915457aa-a06c-4d08-af98-1cbce6ae4112 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.721229] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-915457aa-a06c-4d08-af98-1cbce6ae4112" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.721336] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-915457aa-a06c-4d08-af98-1cbce6ae4112" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.721776] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-915457aa-a06c-4d08-af98-1cbce6ae4112" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.721776] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('915457aa-a06c-4d08-af98-1cbce6ae4112',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.812760] env[65943]: INFO networking_nsxv3.common.synchronization [None req-9b948678-eb84-4339-a54e-c4181c5f5583 tempest-AttachVolumeNegativeTest-962354070 tempest-AttachVolumeNegativeTest-962354070-project-member] Enqueued Resource ID: 915457aa-a06c-4d08-af98-1cbce6ae4112 with Priority: HIGHEST for action security_group_rules [ 1256.813783] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 915457aa-a06c-4d08-af98-1cbce6ae4112 with Priority: HIGHEST for action security_group_rules [ 1256.813783] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-915457aa-a06c-4d08-af98-1cbce6ae4112 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.813783] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-915457aa-a06c-4d08-af98-1cbce6ae4112" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.045800] env[65943]: INFO networking_nsxv3.common.synchronization [req-0863b8df-2067-415b-80b6-d53c1641c390 req-a6697174-39a6-4a29-bc56-abee79bb3dc7 tempest-ServersTestJSON-746248001 tempest-ServersTestJSON-746248001-project-member] Enqueued Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1257.045800] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1257.045800] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.045937] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.046317] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.046317] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.046480] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.046480] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.046567] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.046675] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.046848] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.046848] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.246681] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.246896] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.246977] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.247268] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.247373] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.247482] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 915457aa-a06c-4d08-af98-1cbce6ae4112 already deleted. [ 1257.247567] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-915457aa-a06c-4d08-af98-1cbce6ae4112" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.247717] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-915457aa-a06c-4d08-af98-1cbce6ae4112" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.247888] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-915457aa-a06c-4d08-af98-1cbce6ae4112" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.248035] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('915457aa-a06c-4d08-af98-1cbce6ae4112',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.407246] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-928 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.407504] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-928" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.407504] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-928" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.408900] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-928" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.408900] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.408900] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.408900] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.408900] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.409424] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.409424] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1257.409424] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1257.409424] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1257.409619] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1257.409619] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1257.409701] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1257.410564] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1257.437155] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1257.437347] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1257.437492] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1257.438103] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-928" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.438269] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-b295379a-8bd8-4156-9984-15b613269c13 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.438400] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-b295379a-8bd8-4156-9984-15b613269c13" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.438491] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-b295379a-8bd8-4156-9984-15b613269c13" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.439121] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-b295379a-8bd8-4156-9984-15b613269c13" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.439260] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b295379a-8bd8-4156-9984-15b613269c13',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.548822] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.768987] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.769398] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.769398] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.769398] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.769538] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.769574] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 915457aa-a06c-4d08-af98-1cbce6ae4112 already deleted. [ 1257.769677] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-915457aa-a06c-4d08-af98-1cbce6ae4112" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.942057] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.942360] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.942593] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.942824] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.942998] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.943181] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port b295379a-8bd8-4156-9984-15b613269c13 not found, creating... [ 1257.943462] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.943627] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.943748] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.943976] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.944136] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.944429] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.944585] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.944701] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.944907] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.945063] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.945208] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: b295379a-8bd8-4156-9984-15b613269c13 is going to be created. [ 1257.966217] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.966458] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.966558] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.966827] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.967169] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.967400] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-b295379a-8bd8-4156-9984-15b613269c13" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.051325] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.209050] env[65943]: INFO networking_nsxv3.common.synchronization [req-1b11b87b-e2e0-4c53-87b9-fb5c69687a7f req-b61905c9-be93-48b3-b78d-c6fe6401277c tempest-ServerAddressesNegativeTestJSON-866517100 tempest-ServerAddressesNegativeTestJSON-866517100-project-member] Enqueued Resource ID: 8e1ee83a-4e53-4ab5-84ab-943caf201c5f with Priority: HIGHEST for action security_group_members [ 1258.209746] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e1ee83a-4e53-4ab5-84ab-943caf201c5f with Priority: HIGHEST for action security_group_members [ 1258.210179] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e1ee83a-4e53-4ab5-84ab-943caf201c5f taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.210328] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e1ee83a-4e53-4ab5-84ab-943caf201c5f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.210416] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e1ee83a-4e53-4ab5-84ab-943caf201c5f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.210671] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e1ee83a-4e53-4ab5-84ab-943caf201c5f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.210867] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.211072] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.211072] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.211275] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.211367] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.211465] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e1ee83a-4e53-4ab5-84ab-943caf201c5f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.554136] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.554347] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.554441] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.554727] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.554867] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.555081] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1a36d99-a044-4987-8943-d83852cf66f8 is going to be updated. [ 1258.589736] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.589736] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.590065] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.590065] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.590224] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.604288] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: IN_PROGRESS for 2s [ 1258.714299] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.714531] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.714619] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.714956] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.715129] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.715488] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.715598] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.715709] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.715982] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.716128] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.716282] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e1ee83a-4e53-4ab5-84ab-943caf201c5f is going to be updated. [ 1258.726140] env[65943]: INFO networking_nsxv3.common.synchronization [req-0863b8df-2067-415b-80b6-d53c1641c390 req-99dfd20c-61cb-42da-a307-77904d51dd72 service nova] Enqueued Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_rules [ 1258.726327] env[65943]: INFO networking_nsxv3.common.synchronization [req-0863b8df-2067-415b-80b6-d53c1641c390 req-99dfd20c-61cb-42da-a307-77904d51dd72 service nova] Enqueued Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1258.726513] env[65943]: INFO networking_nsxv3.common.synchronization [req-0863b8df-2067-415b-80b6-d53c1641c390 req-99dfd20c-61cb-42da-a307-77904d51dd72 service nova] Enqueued Resource ID: b295379a-8bd8-4156-9984-15b613269c13 with Priority: HIGHEST for action port [ 1258.727260] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_rules [ 1258.727403] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1258.727502] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b295379a-8bd8-4156-9984-15b613269c13 with Priority: HIGHEST for action port [ 1258.727778] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.728041] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.728141] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.728372] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.728467] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.729405] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.729524] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.729766] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-b295379a-8bd8-4156-9984-15b613269c13 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.729922] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b295379a-8bd8-4156-9984-15b613269c13" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.729997] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b295379a-8bd8-4156-9984-15b613269c13" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.730200] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b295379a-8bd8-4156-9984-15b613269c13" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.730279] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b295379a-8bd8-4156-9984-15b613269c13',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.756703] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.756914] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.756914] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.757151] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.757339] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.766562] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e1ee83a-4e53-4ab5-84ab-943caf201c5f in Status: IN_PROGRESS for 2s [ 1259.232412] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.232707] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.232756] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b295379a-8bd8-4156-9984-15b613269c13 with status ACTIVE [ 1259.232907] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.233093] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.233158] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.233366] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.233564] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.233653] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.233762] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.233762] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.233894] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.233973] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.234169] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.234255] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.234311] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.234486] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.234544] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.234602] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b295379a-8bd8-4156-9984-15b613269c13 is going to be updated. [ 1259.261177] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.261373] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.261750] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.261891] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.262168] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.262362] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b295379a-8bd8-4156-9984-15b613269c13" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.280049] env[65943]: INFO networking_nsxv3.common.synchronization [req-e7f2e380-834c-44eb-aab8-3c302b07583e req-354848cf-4983-4f2c-b1b1-ccfb12663811 tempest-AttachVolumeTestJSON-1035762737 tempest-AttachVolumeTestJSON-1035762737-project-member] Enqueued Resource ID: 036b36e3-f557-44a3-a77b-61a8567a6143 with Priority: HIGHEST for action security_group_members [ 1259.280542] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 036b36e3-f557-44a3-a77b-61a8567a6143 with Priority: HIGHEST for action security_group_members [ 1259.280959] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-036b36e3-f557-44a3-a77b-61a8567a6143 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.281122] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-036b36e3-f557-44a3-a77b-61a8567a6143" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.281174] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-036b36e3-f557-44a3-a77b-61a8567a6143" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.281441] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-036b36e3-f557-44a3-a77b-61a8567a6143" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.281606] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.281728] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.281776] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.281918] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.282019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.282116] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('036b36e3-f557-44a3-a77b-61a8567a6143',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.626541] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-102 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.626747] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-102" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.626900] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-102" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.627282] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-102" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.627572] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.627792] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.627885] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.628150] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.628315] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.628539] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1259.628651] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1259.628757] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1259.628860] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1259.628965] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1259.629083] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1259.629223] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1259.650477] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1259.650664] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1259.650782] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1259.651022] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-102" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.651349] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-514ec8f7-d04b-4f99-bfd7-39a9096f0603 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.651525] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-514ec8f7-d04b-4f99-bfd7-39a9096f0603" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.651645] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-514ec8f7-d04b-4f99-bfd7-39a9096f0603" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.652019] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-514ec8f7-d04b-4f99-bfd7-39a9096f0603" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.652163] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('514ec8f7-d04b-4f99-bfd7-39a9096f0603',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.785447] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.785447] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.785632] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.785676] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.785766] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.785974] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.786098] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.786168] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.786358] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.786439] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.786531] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 036b36e3-f557-44a3-a77b-61a8567a6143 already deleted. [ 1259.786611] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-036b36e3-f557-44a3-a77b-61a8567a6143" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.154938] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.155208] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.155396] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.155742] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.155938] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.156156] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port 514ec8f7-d04b-4f99-bfd7-39a9096f0603 not found, creating... [ 1260.156465] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.156638] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.156757] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.156995] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.157155] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.157466] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.157621] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.157738] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.157981] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.158143] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.158283] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: 514ec8f7-d04b-4f99-bfd7-39a9096f0603 is going to be created. [ 1260.189122] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.189417] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.189579] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.189718] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.190019] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.190269] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-514ec8f7-d04b-4f99-bfd7-39a9096f0603" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.617671] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: SUCCESS [ 1260.617671] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.618097] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.618097] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.618299] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.618418] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.618491] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.618672] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.618758] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.618865] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.776786] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e1ee83a-4e53-4ab5-84ab-943caf201c5f in Status: SUCCESS [ 1260.776981] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e1ee83a-4e53-4ab5-84ab-943caf201c5f deletion is rescheduled due to dependency. [ 1260.777139] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e1ee83a-4e53-4ab5-84ab-943caf201c5f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.892871] env[65943]: INFO networking_nsxv3.common.synchronization [req-e7f2e380-834c-44eb-aab8-3c302b07583e req-2664f4fc-bc87-4156-9255-f231890b2821 service nova] Enqueued Resource ID: 036b36e3-f557-44a3-a77b-61a8567a6143 with Priority: HIGHEST for action security_group_rules [ 1260.892967] env[65943]: INFO networking_nsxv3.common.synchronization [req-e7f2e380-834c-44eb-aab8-3c302b07583e req-2664f4fc-bc87-4156-9255-f231890b2821 service nova] Enqueued Resource ID: 036b36e3-f557-44a3-a77b-61a8567a6143 with Priority: HIGHEST for action security_group_members [ 1260.893088] env[65943]: INFO networking_nsxv3.common.synchronization [req-e7f2e380-834c-44eb-aab8-3c302b07583e req-2664f4fc-bc87-4156-9255-f231890b2821 service nova] Enqueued Resource ID: 514ec8f7-d04b-4f99-bfd7-39a9096f0603 with Priority: HIGHEST for action port [ 1260.893599] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 036b36e3-f557-44a3-a77b-61a8567a6143 with Priority: HIGHEST for action security_group_rules [ 1260.893740] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 036b36e3-f557-44a3-a77b-61a8567a6143 with Priority: HIGHEST for action security_group_members [ 1260.894021] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 514ec8f7-d04b-4f99-bfd7-39a9096f0603 with Priority: HIGHEST for action port [ 1260.894198] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-036b36e3-f557-44a3-a77b-61a8567a6143 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.894345] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-036b36e3-f557-44a3-a77b-61a8567a6143" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.894450] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-036b36e3-f557-44a3-a77b-61a8567a6143" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.894617] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-036b36e3-f557-44a3-a77b-61a8567a6143" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.894763] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('036b36e3-f557-44a3-a77b-61a8567a6143',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.895720] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-036b36e3-f557-44a3-a77b-61a8567a6143 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.895846] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-036b36e3-f557-44a3-a77b-61a8567a6143" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.895971] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-036b36e3-f557-44a3-a77b-61a8567a6143" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.896209] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-036b36e3-f557-44a3-a77b-61a8567a6143" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.896379] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.896517] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.896595] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.896763] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.896868] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.897013] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('036b36e3-f557-44a3-a77b-61a8567a6143',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.897876] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-514ec8f7-d04b-4f99-bfd7-39a9096f0603 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.898022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-514ec8f7-d04b-4f99-bfd7-39a9096f0603" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.898118] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-514ec8f7-d04b-4f99-bfd7-39a9096f0603" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.898362] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-514ec8f7-d04b-4f99-bfd7-39a9096f0603" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.898466] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('514ec8f7-d04b-4f99-bfd7-39a9096f0603',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.122950] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.401109] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-036b36e3-f557-44a3-a77b-61a8567a6143 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.401109] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-036b36e3-f557-44a3-a77b-61a8567a6143" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.401330] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('036b36e3-f557-44a3-a77b-61a8567a6143',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.402777] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 514ec8f7-d04b-4f99-bfd7-39a9096f0603 with status ACTIVE [ 1261.403100] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.403100] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.404564] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.404564] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.404564] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.404564] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.404564] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.404564] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.404564] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.404564] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.404564] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.404564] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.405041] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.405041] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.405041] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.405041] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 514ec8f7-d04b-4f99-bfd7-39a9096f0603 is going to be updated. [ 1261.425857] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.426081] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.426081] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.426288] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.426420] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.426579] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-514ec8f7-d04b-4f99-bfd7-39a9096f0603" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.626168] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.904059] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('036b36e3-f557-44a3-a77b-61a8567a6143',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.128988] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.129169] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.129259] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.129644] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.129790] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.129918] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1a36d99-a044-4987-8943-d83852cf66f8 is going to be updated. [ 1262.158969] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.159174] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.159220] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.159401] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.159547] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.168296] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: IN_PROGRESS for 2s [ 1262.406388] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.406975] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.407136] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.407366] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.407458] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.407559] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 036b36e3-f557-44a3-a77b-61a8567a6143 is going to be created. [ 1262.431971] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.432245] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.432245] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.432390] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.432553] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.442775] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 036b36e3-f557-44a3-a77b-61a8567a6143 in Status: UNINITIALIZED for 2s [ 1262.527562] env[65943]: INFO networking_nsxv3.common.synchronization [req-613f69f8-0dd0-476c-afb1-bf15274377d0 req-43f06eb1-55e8-49d9-981d-ae49bef71c08 tempest-AttachVolumeNegativeTest-962354070 tempest-AttachVolumeNegativeTest-962354070-project-member] Enqueued Resource ID: 915457aa-a06c-4d08-af98-1cbce6ae4112 with Priority: HIGHEST for action security_group_members [ 1262.528218] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 915457aa-a06c-4d08-af98-1cbce6ae4112 with Priority: HIGHEST for action security_group_members [ 1262.532458] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-915457aa-a06c-4d08-af98-1cbce6ae4112 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.532656] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-915457aa-a06c-4d08-af98-1cbce6ae4112" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.532729] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-915457aa-a06c-4d08-af98-1cbce6ae4112" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.533014] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-915457aa-a06c-4d08-af98-1cbce6ae4112" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.533233] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.534015] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.534015] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.534015] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.534015] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.534015] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('915457aa-a06c-4d08-af98-1cbce6ae4112',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.037158] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.037562] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.037562] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.037658] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.037658] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.037942] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.038077] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.038151] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.038318] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.038400] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.038522] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 915457aa-a06c-4d08-af98-1cbce6ae4112 already deleted. [ 1263.038640] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-915457aa-a06c-4d08-af98-1cbce6ae4112" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.039939] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-94 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.040137] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-94" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.040293] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-94" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.040571] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-94" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.040888] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.041072] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.041220] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.041438] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.041578] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.041809] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1263.041921] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1263.042041] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1263.042196] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1263.042326] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1263.042451] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1263.042599] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1263.065064] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1263.065064] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1263.065064] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1263.065064] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-94" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.065371] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-5cfbac99-141d-4394-a6a0-3488e79584c2 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.065603] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-5cfbac99-141d-4394-a6a0-3488e79584c2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.065745] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-5cfbac99-141d-4394-a6a0-3488e79584c2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.066227] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-5cfbac99-141d-4394-a6a0-3488e79584c2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.067643] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cfbac99-141d-4394-a6a0-3488e79584c2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.569732] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.570203] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.570444] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.571050] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.571142] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.571416] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port 5cfbac99-141d-4394-a6a0-3488e79584c2 not found, creating... [ 1263.571862] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.572229] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.572453] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.572817] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.573108] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.573605] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.573910] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.574161] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.574495] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.574746] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.574988] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: 5cfbac99-141d-4394-a6a0-3488e79584c2 is going to be created. [ 1263.599311] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.599689] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.599971] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.600428] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.600796] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.601254] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-5cfbac99-141d-4394-a6a0-3488e79584c2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.180708] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: SUCCESS [ 1264.181431] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.181431] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.181524] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.181658] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.181775] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.181858] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.182079] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.182299] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.182383] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.182440] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.343497] env[65943]: INFO networking_nsxv3.common.synchronization [req-613f69f8-0dd0-476c-afb1-bf15274377d0 req-72cb5b4e-b2f7-405d-bfbc-dec126374ace service nova] Enqueued Resource ID: 915457aa-a06c-4d08-af98-1cbce6ae4112 with Priority: HIGHEST for action security_group_rules [ 1264.343703] env[65943]: INFO networking_nsxv3.common.synchronization [req-613f69f8-0dd0-476c-afb1-bf15274377d0 req-72cb5b4e-b2f7-405d-bfbc-dec126374ace service nova] Enqueued Resource ID: 915457aa-a06c-4d08-af98-1cbce6ae4112 with Priority: HIGHEST for action security_group_members [ 1264.343831] env[65943]: INFO networking_nsxv3.common.synchronization [req-613f69f8-0dd0-476c-afb1-bf15274377d0 req-72cb5b4e-b2f7-405d-bfbc-dec126374ace service nova] Enqueued Resource ID: 5cfbac99-141d-4394-a6a0-3488e79584c2 with Priority: HIGHEST for action port [ 1264.344519] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 915457aa-a06c-4d08-af98-1cbce6ae4112 with Priority: HIGHEST for action security_group_rules [ 1264.344709] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 915457aa-a06c-4d08-af98-1cbce6ae4112 with Priority: HIGHEST for action security_group_members [ 1264.344824] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cfbac99-141d-4394-a6a0-3488e79584c2 with Priority: HIGHEST for action port [ 1264.345493] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-915457aa-a06c-4d08-af98-1cbce6ae4112 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.345664] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-915457aa-a06c-4d08-af98-1cbce6ae4112" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.345664] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-915457aa-a06c-4d08-af98-1cbce6ae4112" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.345890] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-915457aa-a06c-4d08-af98-1cbce6ae4112" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.346094] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('915457aa-a06c-4d08-af98-1cbce6ae4112',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.347560] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-915457aa-a06c-4d08-af98-1cbce6ae4112 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.347701] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-915457aa-a06c-4d08-af98-1cbce6ae4112" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.347757] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-915457aa-a06c-4d08-af98-1cbce6ae4112" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.347957] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-915457aa-a06c-4d08-af98-1cbce6ae4112" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.348496] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.349230] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.349230] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.349426] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.350354] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.350354] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('915457aa-a06c-4d08-af98-1cbce6ae4112',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.353035] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-5cfbac99-141d-4394-a6a0-3488e79584c2 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.353226] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5cfbac99-141d-4394-a6a0-3488e79584c2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.353382] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5cfbac99-141d-4394-a6a0-3488e79584c2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.354891] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5cfbac99-141d-4394-a6a0-3488e79584c2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.355062] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cfbac99-141d-4394-a6a0-3488e79584c2',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.462970] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 036b36e3-f557-44a3-a77b-61a8567a6143 in Status: SUCCESS [ 1264.463296] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-036b36e3-f557-44a3-a77b-61a8567a6143" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.463398] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-036b36e3-f557-44a3-a77b-61a8567a6143" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.463593] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-036b36e3-f557-44a3-a77b-61a8567a6143" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.463785] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.465169] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.465169] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.465169] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.465169] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.465169] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-036b36e3-f557-44a3-a77b-61a8567a6143" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.465169] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('036b36e3-f557-44a3-a77b-61a8567a6143',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.684509] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.685301] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.685301] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.685301] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.685497] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.685497] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.685664] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.686070] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.686196] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.686356] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.686669] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.686777] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.686843] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.687078] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.687304] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.687464] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.687580] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.687812] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.688292] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.688292] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.688292] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.847983] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-915457aa-a06c-4d08-af98-1cbce6ae4112 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.848165] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-915457aa-a06c-4d08-af98-1cbce6ae4112" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.853622] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('915457aa-a06c-4d08-af98-1cbce6ae4112',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.860768] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5cfbac99-141d-4394-a6a0-3488e79584c2 with status ACTIVE [ 1264.861259] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.861259] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.861442] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.861539] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.861638] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.861830] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.861924] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.862072] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.862173] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.862234] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.862463] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.862544] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.862864] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.862864] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.862864] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.863022] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5cfbac99-141d-4394-a6a0-3488e79584c2 is going to be updated. [ 1264.918223] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.918526] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.918526] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.918689] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.918815] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.918980] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5cfbac99-141d-4394-a6a0-3488e79584c2" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.969458] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('036b36e3-f557-44a3-a77b-61a8567a6143',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.191367] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b1a36d99-a044-4987-8943-d83852cf66f8: rpc.has_security_group_logging(os_id): False [ 1265.228412] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.228412] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.228412] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.228412] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.228674] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.228790] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.228790] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.228884] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.228982] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.229088] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.229286] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.229378] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.229436] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.229574] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.229648] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.229887] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.230079] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.230145] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.230318] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.230404] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.230493] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1a36d99-a044-4987-8943-d83852cf66f8 is going to be updated. [ 1265.352924] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.353327] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.353478] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.353789] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.353999] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.355876] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('915457aa-a06c-4d08-af98-1cbce6ae4112',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.379131] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: IN_PROGRESS for 2s [ 1265.474640] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 036b36e3-f557-44a3-a77b-61a8567a6143: rpc.has_security_group_logging(os_id): False [ 1265.500340] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.500340] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.500340] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.500623] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.501583] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.501583] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.501583] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.501583] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.501583] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.501583] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.501898] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 036b36e3-f557-44a3-a77b-61a8567a6143 is going to be created. [ 1265.589221] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.589438] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.589526] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.590389] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.591056] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.604952] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 036b36e3-f557-44a3-a77b-61a8567a6143 in Status: IN_PROGRESS for 2s [ 1265.858974] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.859160] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.859234] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.859501] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.859609] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.859715] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 915457aa-a06c-4d08-af98-1cbce6ae4112 is going to be created. [ 1265.885892] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.886059] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.886135] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.886349] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.886507] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.899882] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 915457aa-a06c-4d08-af98-1cbce6ae4112 in Status: UNINITIALIZED for 2s [ 1267.428577] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: SUCCESS [ 1267.428942] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.618957] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 036b36e3-f557-44a3-a77b-61a8567a6143 in Status: SUCCESS [ 1267.619217] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-036b36e3-f557-44a3-a77b-61a8567a6143" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.911214] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 915457aa-a06c-4d08-af98-1cbce6ae4112 in Status: SUCCESS [ 1267.911471] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-915457aa-a06c-4d08-af98-1cbce6ae4112" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.911952] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-915457aa-a06c-4d08-af98-1cbce6ae4112" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.911952] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-915457aa-a06c-4d08-af98-1cbce6ae4112" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.912097] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.912225] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.912383] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.912518] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.912615] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.912748] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-915457aa-a06c-4d08-af98-1cbce6ae4112" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.912804] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('915457aa-a06c-4d08-af98-1cbce6ae4112',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.416691] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('915457aa-a06c-4d08-af98-1cbce6ae4112',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.919222] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 915457aa-a06c-4d08-af98-1cbce6ae4112: rpc.has_security_group_logging(os_id): False [ 1268.939119] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.939333] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.939333] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.939575] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.939722] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.940089] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.940225] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.940270] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.940476] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.940570] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.940651] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 915457aa-a06c-4d08-af98-1cbce6ae4112 is going to be created. [ 1269.021325] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.021508] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.021596] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.021866] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.022139] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.037200] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 915457aa-a06c-4d08-af98-1cbce6ae4112 in Status: IN_PROGRESS for 2s [ 1269.346157] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1269.346312] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1271.054518] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 915457aa-a06c-4d08-af98-1cbce6ae4112 in Status: SUCCESS [ 1271.054882] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-915457aa-a06c-4d08-af98-1cbce6ae4112" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.241167] env[65943]: INFO networking_nsxv3.common.synchronization [req-1fe941b2-0da3-41bf-a6c5-a46743eabef6 req-ff8b05d7-0c9d-4756-99ec-12894a243649 tempest-ServersTestJSON-746248001 tempest-ServersTestJSON-746248001-project-member] Enqueued Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1271.241353] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1271.241702] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.241839] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.241907] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.242153] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.242341] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.242467] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.242533] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.242712] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.242809] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.242934] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.745514] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.247899] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.750978] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.751193] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.751193] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.751450] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.751544] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.751645] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1a36d99-a044-4987-8943-d83852cf66f8 is going to be updated. [ 1272.782778] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.783014] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.783014] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.783197] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.783352] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.793563] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: IN_PROGRESS for 2s [ 1274.806068] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: SUCCESS [ 1274.806466] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.243035] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1276.243467] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1280.598184] env[65943]: INFO networking_nsxv3.common.synchronization [req-a0c1ae55-825d-4371-a2ee-ccf573c5e387 req-23e15502-dd32-4f89-be60-0c8c4029b5df tempest-ServersTestJSON-746248001 tempest-ServersTestJSON-746248001-project-member] Enqueued Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1280.598745] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1280.599202] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.599350] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.599416] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.599620] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.599807] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.599906] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.600022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.600146] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.600233] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.600325] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.952322] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-928 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.952651] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-928" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.952733] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-928" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.952940] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-928" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.953249] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.953469] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.953592] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.953813] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.953980] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.954203] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1280.954316] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1280.954422] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1280.954526] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1280.954632] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1280.954733] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1280.954860] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1280.977706] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1280.977915] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1280.978032] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1280.978179] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-928" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.978498] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-b38b3913-4d43-4286-8201-348bd0cf40a5 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.978670] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-b38b3913-4d43-4286-8201-348bd0cf40a5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.978788] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-b38b3913-4d43-4286-8201-348bd0cf40a5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.979155] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-b38b3913-4d43-4286-8201-348bd0cf40a5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.979300] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b38b3913-4d43-4286-8201-348bd0cf40a5',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.103121] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.482101] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.482384] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.482449] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.482699] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.482845] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.482995] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port b38b3913-4d43-4286-8201-348bd0cf40a5 not found, creating... [ 1281.483299] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.483458] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.483573] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.483787] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.483922] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.484208] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.484361] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.484475] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.484676] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.484807] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.484941] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: b38b3913-4d43-4286-8201-348bd0cf40a5 is going to be created. [ 1281.505821] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.506131] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.506311] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.506644] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.506955] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.507268] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-b38b3913-4d43-4286-8201-348bd0cf40a5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.605327] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.108045] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.108045] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.108273] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.108460] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.108568] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.108671] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1a36d99-a044-4987-8943-d83852cf66f8 is going to be updated. [ 1282.141485] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.141679] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.141679] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.141900] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.142069] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.151556] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: IN_PROGRESS for 2s [ 1282.205655] env[65943]: INFO networking_nsxv3.common.synchronization [req-a0c1ae55-825d-4371-a2ee-ccf573c5e387 req-1b5c7c45-677c-4248-817b-ec0cb2ff4c95 service nova] Enqueued Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_rules [ 1282.205655] env[65943]: INFO networking_nsxv3.common.synchronization [req-a0c1ae55-825d-4371-a2ee-ccf573c5e387 req-1b5c7c45-677c-4248-817b-ec0cb2ff4c95 service nova] Enqueued Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1282.205822] env[65943]: INFO networking_nsxv3.common.synchronization [req-a0c1ae55-825d-4371-a2ee-ccf573c5e387 req-1b5c7c45-677c-4248-817b-ec0cb2ff4c95 service nova] Enqueued Resource ID: b38b3913-4d43-4286-8201-348bd0cf40a5 with Priority: HIGHEST for action port [ 1282.206446] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_rules [ 1282.206590] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1282.206724] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b38b3913-4d43-4286-8201-348bd0cf40a5 with Priority: HIGHEST for action port [ 1282.207106] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.207262] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.207350] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.207604] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.207716] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.208745] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.208866] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.209074] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-b38b3913-4d43-4286-8201-348bd0cf40a5 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.209232] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b38b3913-4d43-4286-8201-348bd0cf40a5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.209264] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b38b3913-4d43-4286-8201-348bd0cf40a5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.209426] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b38b3913-4d43-4286-8201-348bd0cf40a5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.209505] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b38b3913-4d43-4286-8201-348bd0cf40a5',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.711560] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.711984] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.711984] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b38b3913-4d43-4286-8201-348bd0cf40a5 with status ACTIVE [ 1282.712200] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.712200] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.712200] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.712391] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.712479] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.712656] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.712752] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.712809] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.712956] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.713048] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.713228] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.713318] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.713374] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.713505] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.713568] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.713652] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b38b3913-4d43-4286-8201-348bd0cf40a5 is going to be updated. [ 1282.735252] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.735482] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.735482] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.735674] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.735811] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.735972] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b38b3913-4d43-4286-8201-348bd0cf40a5" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.162768] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: SUCCESS [ 1284.163159] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.163218] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.163472] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.163689] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.163818] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.163887] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.163997] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.164112] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.164244] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.666693] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.168914] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.671209] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.671425] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.671487] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.671668] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.671763] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.671859] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1a36d99-a044-4987-8943-d83852cf66f8 is going to be updated. [ 1285.705713] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.705917] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.705917] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.706151] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.706299] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.718244] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: IN_PROGRESS for 2s [ 1286.967028] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-454 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.967028] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-454" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.967028] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-454" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.967028] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-454" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.967028] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.967028] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.967028] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.967618] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.967856] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.968166] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1286.968328] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1286.968470] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1286.968608] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1286.968763] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1286.968901] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1286.969080] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1286.989917] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1286.990211] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1286.990414] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1286.990628] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-454" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.990981] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-9d42a825-1b61-42bb-a185-c70d68cf1aaf taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.991209] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-9d42a825-1b61-42bb-a185-c70d68cf1aaf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.991380] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-9d42a825-1b61-42bb-a185-c70d68cf1aaf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.991685] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-9d42a825-1b61-42bb-a185-c70d68cf1aaf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.991853] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d42a825-1b61-42bb-a185-c70d68cf1aaf',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.207356] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1287.207534] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1287.494599] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.494830] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.494946] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.495358] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.495561] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.495889] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.496130] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.496290] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.496553] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.496722] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.497052] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.497262] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.497410] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.497650] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.497816] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.498011] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: 9d42a825-1b61-42bb-a185-c70d68cf1aaf is going to be updated. [ 1287.529898] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.530254] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.530422] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.530715] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.530916] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.531194] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-9d42a825-1b61-42bb-a185-c70d68cf1aaf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.732996] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: SUCCESS [ 1287.733261] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.733441] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.733666] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.733859] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.733974] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.734054] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.734209] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.734290] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.734381] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.734472] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.203453] env[65943]: INFO networking_nsxv3.common.synchronization [req-8b85b920-f881-4022-a0ad-66335c8de789 req-be65d479-b642-4de2-b558-0ccbda96dbf0 service nova] Enqueued Resource ID: 2880c629-d8d0-45b5-b939-d99c78caab70 with Priority: HIGHEST for action security_group_rules [ 1288.203784] env[65943]: INFO networking_nsxv3.common.synchronization [req-8b85b920-f881-4022-a0ad-66335c8de789 req-be65d479-b642-4de2-b558-0ccbda96dbf0 service nova] Enqueued Resource ID: 2880c629-d8d0-45b5-b939-d99c78caab70 with Priority: HIGHEST for action security_group_members [ 1288.203903] env[65943]: INFO networking_nsxv3.common.synchronization [req-8b85b920-f881-4022-a0ad-66335c8de789 req-be65d479-b642-4de2-b558-0ccbda96dbf0 service nova] Enqueued Resource ID: 9d42a825-1b61-42bb-a185-c70d68cf1aaf with Priority: HIGHEST for action port [ 1288.204672] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2880c629-d8d0-45b5-b939-d99c78caab70 with Priority: HIGHEST for action security_group_rules [ 1288.204872] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2880c629-d8d0-45b5-b939-d99c78caab70 with Priority: HIGHEST for action security_group_members [ 1288.205078] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d42a825-1b61-42bb-a185-c70d68cf1aaf with Priority: HIGHEST for action port [ 1288.205391] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2880c629-d8d0-45b5-b939-d99c78caab70 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.205515] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.205584] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.205786] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.205877] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2880c629-d8d0-45b5-b939-d99c78caab70',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.207083] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2880c629-d8d0-45b5-b939-d99c78caab70 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.207215] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.207276] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.207451] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.207605] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.207701] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.207765] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.207909] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.208030] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.208135] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2880c629-d8d0-45b5-b939-d99c78caab70',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.208904] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d42a825-1b61-42bb-a185-c70d68cf1aaf taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.209029] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d42a825-1b61-42bb-a185-c70d68cf1aaf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.209382] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d42a825-1b61-42bb-a185-c70d68cf1aaf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.209382] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d42a825-1b61-42bb-a185-c70d68cf1aaf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.209382] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d42a825-1b61-42bb-a185-c70d68cf1aaf',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.236224] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.236432] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.236432] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.236651] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.236817] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.236952] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.237030] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.237144] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.237230] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.237319] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.237468] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.237561] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.237618] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.237796] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.237983] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.238106] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.238159] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.238296] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.238373] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.238454] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.238539] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.711228] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2880c629-d8d0-45b5-b939-d99c78caab70 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.711393] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.711568] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2880c629-d8d0-45b5-b939-d99c78caab70',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.712482] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9d42a825-1b61-42bb-a185-c70d68cf1aaf with status ACTIVE [ 1288.712668] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.712784] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.712850] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.713065] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.713158] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.713332] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.713437] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.714035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.714035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.714035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.714035] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.714035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.714035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.714303] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.714303] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.714303] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9d42a825-1b61-42bb-a185-c70d68cf1aaf is going to be updated. [ 1288.740944] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b1a36d99-a044-4987-8943-d83852cf66f8: rpc.has_security_group_logging(os_id): False [ 1288.743756] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.743891] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.743962] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.744184] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.744326] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.744481] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d42a825-1b61-42bb-a185-c70d68cf1aaf" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.759904] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.760158] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.760158] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.760357] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.760447] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.760640] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.760739] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.760800] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.760944] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.761031] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.761252] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.761350] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.761409] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.761547] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.761619] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.761805] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.761896] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.761954] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.762105] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.762178] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.762261] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1a36d99-a044-4987-8943-d83852cf66f8 is going to be updated. [ 1288.860813] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.861068] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.861068] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.861270] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.861418] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.883805] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: IN_PROGRESS for 2s [ 1289.216703] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2880c629-d8d0-45b5-b939-d99c78caab70',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.719684] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.719990] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.720120] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.720474] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.720642] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.720810] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2880c629-d8d0-45b5-b939-d99c78caab70 is going to be updated. [ 1289.766849] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.767087] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.767087] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.767366] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.767525] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.779544] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2880c629-d8d0-45b5-b939-d99c78caab70 in Status: IN_PROGRESS for 2s [ 1290.336517] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.336845] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.336845] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.337187] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.337187] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.840194] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.902338] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: SUCCESS [ 1290.902621] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.344136] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.672021] env[65943]: INFO networking_nsxv3.common.synchronization [req-e5cbc685-fcdc-4648-a110-97a6c5e2e515 req-49becfd6-7afb-417f-a112-08b774b1e112 tempest-ServersTestJSON-746248001 tempest-ServersTestJSON-746248001-project-member] Enqueued Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1291.672605] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1291.672904] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.673036] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.673106] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.673426] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.673478] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.673529] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.673596] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.673741] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.673826] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.673917] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.789910] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2880c629-d8d0-45b5-b939-d99c78caab70 in Status: SUCCESS [ 1291.790194] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.790350] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.790579] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.790821] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.790930] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.790985] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.791187] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.791282] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.791347] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.791437] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2880c629-d8d0-45b5-b939-d99c78caab70',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.846348] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1291.846524] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1292.176702] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.293683] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2880c629-d8d0-45b5-b939-d99c78caab70',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.639622] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.639622] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.639622] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.640050] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.653613] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1292.654866] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.656339] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1292.679346] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.699060] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.699060] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.699060] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.699060] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.713170] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.714116] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1292.714254] env[65943]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65943) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1292.714338] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1292.754023] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.754256] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.754314] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.754541] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.755855] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.756047] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1292.795569] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2880c629-d8d0-45b5-b939-d99c78caab70: rpc.has_security_group_logging(os_id): False [ 1292.815846] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.816071] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.816134] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.816367] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.838671] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.839117] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.839292] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.839407] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.839669] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.839809] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.839930] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2880c629-d8d0-45b5-b939-d99c78caab70 is going to be updated. [ 1292.850946] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.851423] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.851423] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.851640] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.851951] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.852323] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1292.920909] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.921200] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.921200] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.921376] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.921524] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.936661] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2880c629-d8d0-45b5-b939-d99c78caab70 in Status: IN_PROGRESS for 2s [ 1292.999433] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.999722] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.999792] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.999968] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.000364] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.000690] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:39. [ 1293.000792] env[65943]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'5e68ec8e-5429-41d7-8e64-cf2efa140ba3', '6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b', '735ba0f8-8502-49b1-93a7-4ac595ca177c', '915457aa-a06c-4d08-af98-1cbce6ae4112', 'b1a36d99-a044-4987-8943-d83852cf66f8', '036b36e3-f557-44a3-a77b-61a8567a6143', '7bcdadce-edf2-43d0-a8d9-43033bb27e63', 'a97b14a2-a99a-4ce7-8cba-fd84de098977', '15454ceb-9062-41fb-908b-b5ae144dbe65', '7bf10448-5be8-4851-a7f0-5ce51163751a', 'c0c81f5e-9888-4914-ab90-42d06116db49', '55c4b60d-641f-4044-8228-251f73d38ecb', '68884628-4b38-403c-8fad-e29dfea783b0', 'ac6bded7-e3ef-4cd4-99c3-8bcb18296764', '8e1ee83a-4e53-4ab5-84ab-943caf201c5f', 'f293d027-3f3e-402a-bfe6-98af5d29163f', 'd97ff6f8-41cc-4974-82fe-bda7247ceb2b', '82c62f05-41a4-43fb-a74d-0baaee3b8043', '7a24c880-984b-4cdd-bb2c-6117349d9d43', '75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a', '655fa9f8-1f2b-4cc8-b0fa-767189dc0172', 'bad8ffbf-a375-4ee1-b522-c5e84af1b840', '8c8a054b-6bee-465e-84da-d50dfdc27f64', '2880c629-d8d0-45b5-b939-d99c78caab70', '3e3d8b17-4394-4674-b793-075706514abb', '9ec3969d-7444-46cd-8273-33276cfbb49e', '45bb0dcc-2197-4aae-a058-937524e3408a', '9a29bac0-8e63-4f6f-957d-9bd116500c7e', 'c9b127ff-135f-4cd2-9456-bc11d98737ce', '2d899613-c950-496a-aec6-9bbbbbf253b5', '1059706e-9846-4d25-98c7-43c5aa686d19', 'b88e0956-a799-4c5e-8e71-323151811fd1', '89dec01a-fac4-47c6-9d76-7e922dba6ec4', 'a3785ccf-0b13-4a67-ba63-81d28e609f6b', '9539d191-87a5-4727-b693-a846f1e6f855', '2b092468-bc6e-49b4-be83-babaf5ab0786', 'dcee84a2-5f8e-4aff-856c-81b817d31434', 'b3cf4dd4-6ece-41ef-bd05-4a81131c66c6', 'cddfb2d8-8ac5-496b-aee4-ea09e6b59edf'} {{(pid=65943) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1293.001101] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1293.024650] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.024910] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.025022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.025348] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.025471] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.025592] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1293.025667] env[65943]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65943) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1293.025742] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1293.133290] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.133508] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.133592] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.133883] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.135243] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.135520] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1293.135607] env[65943]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65943) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1293.135689] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1293.135762] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1293.135861] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/39 resources of Type:Security Group Rules [ 1293.135971] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5e68ec8e-5429-41d7-8e64-cf2efa140ba3 with Priority: HIGH for action security_group_rules [ 1293.136139] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b with Priority: HIGH for action security_group_rules [ 1293.136249] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c with Priority: HIGH for action security_group_rules [ 1293.136336] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 915457aa-a06c-4d08-af98-1cbce6ae4112 with Priority: HIGH for action security_group_rules [ 1293.136473] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGH for action security_group_rules [ 1293.136570] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 036b36e3-f557-44a3-a77b-61a8567a6143 with Priority: HIGH for action security_group_rules [ 1293.137922] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 with Priority: HIGH for action security_group_rules [ 1293.137922] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 with Priority: HIGH for action security_group_rules [ 1293.137922] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGH for action security_group_rules [ 1293.137922] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7bf10448-5be8-4851-a7f0-5ce51163751a with Priority: HIGH for action security_group_rules [ 1293.137922] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGH for action security_group_rules [ 1293.137922] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 55c4b60d-641f-4044-8228-251f73d38ecb with Priority: HIGH for action security_group_rules [ 1293.137922] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 68884628-4b38-403c-8fad-e29dfea783b0 with Priority: HIGH for action security_group_rules [ 1293.137922] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ac6bded7-e3ef-4cd4-99c3-8bcb18296764 with Priority: HIGH for action security_group_rules [ 1293.137922] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8e1ee83a-4e53-4ab5-84ab-943caf201c5f with Priority: HIGH for action security_group_rules [ 1293.137922] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f293d027-3f3e-402a-bfe6-98af5d29163f with Priority: HIGH for action security_group_rules [ 1293.137922] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d97ff6f8-41cc-4974-82fe-bda7247ceb2b with Priority: HIGH for action security_group_rules [ 1293.137922] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 82c62f05-41a4-43fb-a74d-0baaee3b8043 with Priority: HIGH for action security_group_rules [ 1293.137922] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 with Priority: HIGH for action security_group_rules [ 1293.137922] env[65943]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a with Priority: HIGH for action security_group_rules [ 1293.137922] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.183681] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.183885] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.183937] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.184348] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.184473] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.184586] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1a36d99-a044-4987-8943-d83852cf66f8 is going to be updated. [ 1293.218970] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.219235] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.219235] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.219782] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.219782] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.233820] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: IN_PROGRESS for 2s [ 1294.958760] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2880c629-d8d0-45b5-b939-d99c78caab70 in Status: SUCCESS [ 1294.959194] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.247860] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: SUCCESS [ 1295.248133] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.674225] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1296.674592] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1296.674592] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e68ec8e-5429-41d7-8e64-cf2efa140ba3 with Priority: HIGH for action security_group_rules [ 1296.674666] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c with Priority: HIGH for action security_group_rules [ 1296.674732] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 with Priority: HIGH for action security_group_rules [ 1296.674830] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e1ee83a-4e53-4ab5-84ab-943caf201c5f with Priority: HIGH for action security_group_rules [ 1296.674928] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a with Priority: HIGH for action security_group_rules [ 1296.675035] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 with Priority: HIGH for action security_group_rules [ 1296.675132] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82c62f05-41a4-43fb-a74d-0baaee3b8043 with Priority: HIGH for action security_group_rules [ 1296.675221] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d97ff6f8-41cc-4974-82fe-bda7247ceb2b with Priority: HIGH for action security_group_rules [ 1296.675310] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac6bded7-e3ef-4cd4-99c3-8bcb18296764 with Priority: HIGH for action security_group_rules [ 1296.675398] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f293d027-3f3e-402a-bfe6-98af5d29163f with Priority: HIGH for action security_group_rules [ 1296.675483] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68884628-4b38-403c-8fad-e29dfea783b0 with Priority: HIGH for action security_group_rules [ 1296.675571] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55c4b60d-641f-4044-8228-251f73d38ecb with Priority: HIGH for action security_group_rules [ 1296.675657] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c81f5e-9888-4914-ab90-42d06116db49 with Priority: HIGH for action security_group_rules [ 1296.675743] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bf10448-5be8-4851-a7f0-5ce51163751a with Priority: HIGH for action security_group_rules [ 1296.675828] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 with Priority: HIGH for action security_group_rules [ 1296.675912] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 036b36e3-f557-44a3-a77b-61a8567a6143 with Priority: HIGH for action security_group_rules [ 1296.675997] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 with Priority: HIGH for action security_group_rules [ 1296.676096] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGH for action security_group_rules [ 1296.676182] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b with Priority: HIGH for action security_group_rules [ 1296.676271] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 915457aa-a06c-4d08-af98-1cbce6ae4112 with Priority: HIGH for action security_group_rules [ 1296.676610] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e68ec8e-5429-41d7-8e64-cf2efa140ba3 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.676740] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e68ec8e-5429-41d7-8e64-cf2efa140ba3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.676805] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e68ec8e-5429-41d7-8e64-cf2efa140ba3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.677035] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e68ec8e-5429-41d7-8e64-cf2efa140ba3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.677120] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e68ec8e-5429-41d7-8e64-cf2efa140ba3',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.678168] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-735ba0f8-8502-49b1-93a7-4ac595ca177c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.678286] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.678345] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.678522] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.678598] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('735ba0f8-8502-49b1-93a7-4ac595ca177c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.679677] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.679786] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.679852] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.680019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.680633] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7bcdadce-edf2-43d0-a8d9-43033bb27e63',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.681036] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e1ee83a-4e53-4ab5-84ab-943caf201c5f taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.681036] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e1ee83a-4e53-4ab5-84ab-943caf201c5f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.681036] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e1ee83a-4e53-4ab5-84ab-943caf201c5f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.681204] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e1ee83a-4e53-4ab5-84ab-943caf201c5f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.681204] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e1ee83a-4e53-4ab5-84ab-943caf201c5f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.681906] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.682026] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.682026] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.682344] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.682344] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.683018] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a24c880-984b-4cdd-bb2c-6117349d9d43 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.683018] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.683205] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.683205] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.683268] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a24c880-984b-4cdd-bb2c-6117349d9d43',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.684041] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-82c62f05-41a4-43fb-a74d-0baaee3b8043 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.684182] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-82c62f05-41a4-43fb-a74d-0baaee3b8043" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.684252] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-82c62f05-41a4-43fb-a74d-0baaee3b8043" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.684349] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-82c62f05-41a4-43fb-a74d-0baaee3b8043" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.684473] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('82c62f05-41a4-43fb-a74d-0baaee3b8043',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.685063] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d97ff6f8-41cc-4974-82fe-bda7247ceb2b taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.685168] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d97ff6f8-41cc-4974-82fe-bda7247ceb2b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.685224] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d97ff6f8-41cc-4974-82fe-bda7247ceb2b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.685517] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d97ff6f8-41cc-4974-82fe-bda7247ceb2b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.685517] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d97ff6f8-41cc-4974-82fe-bda7247ceb2b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.686455] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac6bded7-e3ef-4cd4-99c3-8bcb18296764 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.686455] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac6bded7-e3ef-4cd4-99c3-8bcb18296764" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.686643] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac6bded7-e3ef-4cd4-99c3-8bcb18296764" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.686690] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac6bded7-e3ef-4cd4-99c3-8bcb18296764" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.686892] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac6bded7-e3ef-4cd4-99c3-8bcb18296764',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.687405] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f293d027-3f3e-402a-bfe6-98af5d29163f taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.687903] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f293d027-3f3e-402a-bfe6-98af5d29163f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.687903] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f293d027-3f3e-402a-bfe6-98af5d29163f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.687903] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f293d027-3f3e-402a-bfe6-98af5d29163f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.687903] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f293d027-3f3e-402a-bfe6-98af5d29163f',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.688511] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68884628-4b38-403c-8fad-e29dfea783b0 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.688611] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68884628-4b38-403c-8fad-e29dfea783b0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.688662] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68884628-4b38-403c-8fad-e29dfea783b0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.688807] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68884628-4b38-403c-8fad-e29dfea783b0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.688882] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68884628-4b38-403c-8fad-e29dfea783b0',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.689576] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55c4b60d-641f-4044-8228-251f73d38ecb taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.689705] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.689705] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.689842] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.689918] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55c4b60d-641f-4044-8228-251f73d38ecb',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.690599] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0c81f5e-9888-4914-ab90-42d06116db49 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.690701] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.690952] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.690952] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.690952] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0c81f5e-9888-4914-ab90-42d06116db49',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.691833] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7bf10448-5be8-4851-a7f0-5ce51163751a taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.691833] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7bf10448-5be8-4851-a7f0-5ce51163751a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.691932] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7bf10448-5be8-4851-a7f0-5ce51163751a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.691996] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7bf10448-5be8-4851-a7f0-5ce51163751a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.692084] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7bf10448-5be8-4851-a7f0-5ce51163751a',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.692858] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15454ceb-9062-41fb-908b-b5ae144dbe65 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.692858] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.692954] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.693032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.693100] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15454ceb-9062-41fb-908b-b5ae144dbe65',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.693757] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-036b36e3-f557-44a3-a77b-61a8567a6143 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.693854] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-036b36e3-f557-44a3-a77b-61a8567a6143" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.694181] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-036b36e3-f557-44a3-a77b-61a8567a6143" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.694181] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-036b36e3-f557-44a3-a77b-61a8567a6143" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.694181] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('036b36e3-f557-44a3-a77b-61a8567a6143',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.694871] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a97b14a2-a99a-4ce7-8cba-fd84de098977 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.695042] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.695042] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.695182] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.695249] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a97b14a2-a99a-4ce7-8cba-fd84de098977',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.695892] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.695996] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.696074] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.696219] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.696311] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.697090] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.697198] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.697198] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.697347] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.697418] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.698072] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-915457aa-a06c-4d08-af98-1cbce6ae4112 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.698166] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-915457aa-a06c-4d08-af98-1cbce6ae4112" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.698232] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-915457aa-a06c-4d08-af98-1cbce6ae4112" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.698374] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-915457aa-a06c-4d08-af98-1cbce6ae4112" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.698465] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('915457aa-a06c-4d08-af98-1cbce6ae4112',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.757909] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.758182] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.758182] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.758369] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.760011] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.760185] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.760991] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.761099] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.762266] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.762266] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.762992] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.762992] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.786154] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.786342] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d97ff6f8-41cc-4974-82fe-bda7247ceb2b is going to be deleted. [ 1296.787223] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.787448] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.808532] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.808704] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e68ec8e-5429-41d7-8e64-cf2efa140ba3 is going to be deleted. [ 1296.809714] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.809964] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.831673] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.831851] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7bcdadce-edf2-43d0-a8d9-43033bb27e63 is going to be deleted. [ 1296.832806] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.833033] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.856836] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.857059] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a is going to be deleted. [ 1296.857952] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.858178] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.859570] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.859712] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.877763] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.877959] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.881177] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.881376] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a24c880-984b-4cdd-bb2c-6117349d9d43 is going to be deleted. [ 1296.882293] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.882536] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.882638] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.882767] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d97ff6f8-41cc-4974-82fe-bda7247ceb2b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.882919] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.883092] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.883171] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.883290] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e68ec8e-5429-41d7-8e64-cf2efa140ba3" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.917593] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.917806] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.917806] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.917962] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.918103] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.918196] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7bcdadce-edf2-43d0-a8d9-43033bb27e63" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.931993] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.932273] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.932273] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.932439] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.932607] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.932733] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75cbc0b9-d39f-4745-93ab-0dbc6fa5fd8a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.946206] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.946436] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.946486] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.946694] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.946838] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.946903] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a24c880-984b-4cdd-bb2c-6117349d9d43" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.203433] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-036b36e3-f557-44a3-a77b-61a8567a6143 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.203707] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-036b36e3-f557-44a3-a77b-61a8567a6143" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.203707] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-036b36e3-f557-44a3-a77b-61a8567a6143" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.203854] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-036b36e3-f557-44a3-a77b-61a8567a6143" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.203924] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.204039] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.204108] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.204259] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.204347] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.204412] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-036b36e3-f557-44a3-a77b-61a8567a6143" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.204499] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('036b36e3-f557-44a3-a77b-61a8567a6143',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.207921] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.208058] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.208191] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.208341] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.208502] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.208597] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.208658] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.208801] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.208889] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.208975] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.209076] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.220354] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-915457aa-a06c-4d08-af98-1cbce6ae4112 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.220566] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-915457aa-a06c-4d08-af98-1cbce6ae4112" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.220566] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-915457aa-a06c-4d08-af98-1cbce6ae4112" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.220802] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-915457aa-a06c-4d08-af98-1cbce6ae4112" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.220955] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.221117] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.221212] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.221379] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.221466] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.221553] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-915457aa-a06c-4d08-af98-1cbce6ae4112" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.221639] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('915457aa-a06c-4d08-af98-1cbce6ae4112',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.261769] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.262028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.262028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.262271] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.264063] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.264189] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.264987] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.265107] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.265851] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.265953] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.267112] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.267202] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.267944] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.268068] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.268767] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.268860] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.269632] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.269722] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.270471] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.270560] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.271268] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.271373] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.272058] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.272155] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.272764] env[65943]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1297.273233] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.273415] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.291417] env[65943]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1297.291984] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.292138] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f293d027-3f3e-402a-bfe6-98af5d29163f is going to be deleted. [ 1297.293127] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.293342] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.314041] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.314218] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 82c62f05-41a4-43fb-a74d-0baaee3b8043 is going to be deleted. [ 1297.315214] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.315437] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.336189] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.336189] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55c4b60d-641f-4044-8228-251f73d38ecb is going to be deleted. [ 1297.337026] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.337237] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.364382] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.364519] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e1ee83a-4e53-4ab5-84ab-943caf201c5f is going to be deleted. [ 1297.365459] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.365677] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.378172] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.378369] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.387377] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.387514] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0c81f5e-9888-4914-ab90-42d06116db49 is going to be deleted. [ 1297.388474] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.388690] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.404467] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.404704] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.418954] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.419154] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7bf10448-5be8-4851-a7f0-5ce51163751a is going to be deleted. [ 1297.420065] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.420346] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.423368] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.423591] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.490852] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.491059] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68884628-4b38-403c-8fad-e29dfea783b0 is going to be deleted. [ 1297.491955] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.492199] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.499581] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.499820] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.518225] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.518444] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.593113] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.593360] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b is going to be deleted. [ 1297.594408] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.594652] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.625319] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.625563] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.671245] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.671432] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a97b14a2-a99a-4ce7-8cba-fd84de098977 is going to be deleted. [ 1297.672488] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.672696] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.706692] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('036b36e3-f557-44a3-a77b-61a8567a6143',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.715713] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.715913] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.715956] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.716187] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.716360] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.716482] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.716585] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.716751] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.716837] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.716926] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.717306] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.717306] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.717306] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.717510] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.717510] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.717594] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.717649] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.717786] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.717877] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.718017] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.718150] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.729890] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('915457aa-a06c-4d08-af98-1cbce6ae4112',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.749820] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.750016] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 735ba0f8-8502-49b1-93a7-4ac595ca177c is going to be deleted. [ 1297.751089] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.751329] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.785957] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.786184] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.786970] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.787080] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.802152] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.802337] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15454ceb-9062-41fb-908b-b5ae144dbe65 is going to be deleted. [ 1297.803314] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.803580] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.808408] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.808614] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.871669] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.871850] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac6bded7-e3ef-4cd4-99c3-8bcb18296764 is going to be deleted. [ 1297.872909] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.873198] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.873323] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.873470] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f293d027-3f3e-402a-bfe6-98af5d29163f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.873697] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.873827] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.873919] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.874173] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-82c62f05-41a4-43fb-a74d-0baaee3b8043" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.874783] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.874965] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.875074] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.875243] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55c4b60d-641f-4044-8228-251f73d38ecb" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.875409] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.875593] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.875675] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.875792] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e1ee83a-4e53-4ab5-84ab-943caf201c5f" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.875924] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.876082] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.876160] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.876278] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0c81f5e-9888-4914-ab90-42d06116db49" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.876447] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.876611] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.876726] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.876918] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7bf10448-5be8-4851-a7f0-5ce51163751a" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.877142] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.877350] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.877442] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.877562] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68884628-4b38-403c-8fad-e29dfea783b0" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.877687] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.877834] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.877910] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.878143] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ef5a2a8-23f4-45b6-86b9-979ba0f9c33b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.878296] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.878458] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.878535] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.878650] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a97b14a2-a99a-4ce7-8cba-fd84de098977" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.894421] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.894633] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.894677] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.894945] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.895059] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.895201] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-735ba0f8-8502-49b1-93a7-4ac595ca177c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.008340] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.008555] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.008599] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.008817] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.008913] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.009060] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac6bded7-e3ef-4cd4-99c3-8bcb18296764" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.009905] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.010038] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.010109] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.010391] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.010480] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.010591] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15454ceb-9062-41fb-908b-b5ae144dbe65" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.211640] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 036b36e3-f557-44a3-a77b-61a8567a6143: rpc.has_security_group_logging(os_id): False [ 1298.220511] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b1a36d99-a044-4987-8943-d83852cf66f8: rpc.has_security_group_logging(os_id): False [ 1298.232028] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.232274] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.232322] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.232633] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.233762] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 915457aa-a06c-4d08-af98-1cbce6ae4112: rpc.has_security_group_logging(os_id): False [ 1298.248162] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.248414] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.257507] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.257702] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.259162] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.259561] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.259652] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.259701] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.259912] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.260013] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.260172] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 036b36e3-f557-44a3-a77b-61a8567a6143 is going to be updated. [ 1298.261689] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.261887] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.291715] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.292127] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.292299] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.292399] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.292718] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.292828] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.293146] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.293294] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.293379] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.293590] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.293682] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.293944] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.294059] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.294134] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.294288] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.294375] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.294500] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1a36d99-a044-4987-8943-d83852cf66f8 is going to be updated. [ 1298.295995] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.296254] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.319479] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.319836] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.319963] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.320043] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.320361] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.320480] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.320547] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 915457aa-a06c-4d08-af98-1cbce6ae4112 is going to be updated. [ 1298.380073] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.380073] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.380073] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.380073] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.380458] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.383136] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.383380] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.383380] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.383562] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.383726] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.397498] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 036b36e3-f557-44a3-a77b-61a8567a6143 in Status: IN_PROGRESS for 2s [ 1298.398349] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: IN_PROGRESS for 2s [ 1298.411696] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.411873] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.411993] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.412190] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.412387] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.431209] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 915457aa-a06c-4d08-af98-1cbce6ae4112 in Status: IN_PROGRESS for 2s [ 1300.428066] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 036b36e3-f557-44a3-a77b-61a8567a6143 in Status: SUCCESS [ 1300.428568] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-036b36e3-f557-44a3-a77b-61a8567a6143" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.433430] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: SUCCESS [ 1300.433661] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.457529] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 915457aa-a06c-4d08-af98-1cbce6ae4112 in Status: SUCCESS [ 1300.457898] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-915457aa-a06c-4d08-af98-1cbce6ae4112" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.982132] env[65943]: INFO networking_nsxv3.common.synchronization [req-6ecf6a96-d550-4c41-9774-45d69b656311 req-de30e6eb-42d2-4c7e-a9e2-c77148d38e01 tempest-ServersTestJSON-746248001 tempest-ServersTestJSON-746248001-project-member] Enqueued Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1300.982329] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1300.982638] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.982760] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.982820] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.983022] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.983177] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.983277] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.983327] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.983473] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.983555] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.983645] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.295981] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock network-928 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.295981] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "network-928" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.295981] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "network-928" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.296209] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "network-928" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.296802] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.297045] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.297287] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.297582] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.297772] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.298065] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1301.298240] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1301.298399] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1301.298530] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1301.298674] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1301.298804] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1301.298947] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1301.318842] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1301.319138] env[65943]: DEBUG dogpile.cache.region [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1301.319138] env[65943]: DEBUG dogpile.lock [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1301.319320] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "network-928" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.319635] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock port-3189548d-9383-4032-ac51-e4f8d4ec9fcd taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.319804] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "port-3189548d-9383-4032-ac51-e4f8d4ec9fcd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.319924] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "port-3189548d-9383-4032-ac51-e4f8d4ec9fcd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.320340] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "port-3189548d-9383-4032-ac51-e4f8d4ec9fcd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.320487] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3189548d-9383-4032-ac51-e4f8d4ec9fcd',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.485930] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.822720] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.822950] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.823097] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.823462] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.823692] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.823913] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Segment Port 3189548d-9383-4032-ac51-e4f8d4ec9fcd not found, creating... [ 1301.824190] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.824350] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.824591] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.824687] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.824895] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.825123] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.825307] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.825505] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.825575] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.825711] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.825851] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Resource: SegmentPort with ID: 3189548d-9383-4032-ac51-e4f8d4ec9fcd is going to be created. [ 1301.847074] env[65943]: DEBUG networking_nsxv3.common.locking [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.847299] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.847425] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.847777] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.848088] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.848334] env[65943]: DEBUG oslo_concurrency.lockutils [None req-5dbabb4e-746a-47d8-b19f-516fda76b0ff None None] Releasing lock "port-3189548d-9383-4032-ac51-e4f8d4ec9fcd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.988331] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.491014] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.491447] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.491447] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.491628] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.491730] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.491839] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1a36d99-a044-4987-8943-d83852cf66f8 is going to be updated. [ 1302.523575] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.523804] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.523804] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.523977] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.524134] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.534828] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: IN_PROGRESS for 2s [ 1302.999082] env[65943]: INFO networking_nsxv3.common.synchronization [req-6ecf6a96-d550-4c41-9774-45d69b656311 req-03b844c9-d11c-4092-93a5-3887813c0a68 service nova] Enqueued Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_rules [ 1302.999350] env[65943]: INFO networking_nsxv3.common.synchronization [req-6ecf6a96-d550-4c41-9774-45d69b656311 req-03b844c9-d11c-4092-93a5-3887813c0a68 service nova] Enqueued Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1302.999467] env[65943]: INFO networking_nsxv3.common.synchronization [req-6ecf6a96-d550-4c41-9774-45d69b656311 req-03b844c9-d11c-4092-93a5-3887813c0a68 service nova] Enqueued Resource ID: 3189548d-9383-4032-ac51-e4f8d4ec9fcd with Priority: HIGHEST for action port [ 1303.000929] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_rules [ 1303.001091] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1303.001211] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3189548d-9383-4032-ac51-e4f8d4ec9fcd with Priority: HIGHEST for action port [ 1303.001515] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.001647] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.001717] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.001913] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.002027] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.002920] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.003066] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.003217] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-3189548d-9383-4032-ac51-e4f8d4ec9fcd taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.003324] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3189548d-9383-4032-ac51-e4f8d4ec9fcd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.003366] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3189548d-9383-4032-ac51-e4f8d4ec9fcd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.003558] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3189548d-9383-4032-ac51-e4f8d4ec9fcd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.003624] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3189548d-9383-4032-ac51-e4f8d4ec9fcd',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.506853] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.507261] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.507324] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3189548d-9383-4032-ac51-e4f8d4ec9fcd with status ACTIVE [ 1303.507537] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.507713] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.507813] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.508090] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.508211] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.508468] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.508589] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.508703] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.508924] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.509095] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.509373] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.509495] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.509578] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.509806] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.509938] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.510247] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3189548d-9383-4032-ac51-e4f8d4ec9fcd is going to be updated. [ 1303.531771] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.532046] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.532046] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.532227] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.532415] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.532619] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3189548d-9383-4032-ac51-e4f8d4ec9fcd" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.354976] env[65943]: INFO networking_nsxv3.common.synchronization [req-0ed479c7-6e66-4bc7-8234-01ba9c9ed61a req-ef36f43d-78c2-4a50-86d9-cd6555aa0e2f tempest-ServerActionsTestOtherB-2092325239 tempest-ServerActionsTestOtherB-2092325239-project-member] Enqueued Resource ID: 2880c629-d8d0-45b5-b939-d99c78caab70 with Priority: HIGHEST for action security_group_members [ 1304.355087] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2880c629-d8d0-45b5-b939-d99c78caab70 with Priority: HIGHEST for action security_group_members [ 1304.355370] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-2880c629-d8d0-45b5-b939-d99c78caab70 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.355490] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.355585] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.355750] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.355893] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.356485] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.356485] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.356485] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.356485] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.356648] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2880c629-d8d0-45b5-b939-d99c78caab70',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.544247] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: SUCCESS [ 1304.544607] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.544647] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.544927] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.545169] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.545327] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.545420] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.545609] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.545699] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.545799] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.858690] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.858927] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.858927] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.859170] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.859258] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.859475] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.859577] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.859632] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.859781] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.859855] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.859939] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2880c629-d8d0-45b5-b939-d99c78caab70 is going to be updated. [ 1304.893615] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.893790] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.893838] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.894099] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.894277] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.906282] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2880c629-d8d0-45b5-b939-d99c78caab70 in Status: IN_PROGRESS for 2s [ 1305.048728] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.551894] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.055068] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.055068] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.055068] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.055376] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.055410] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.055534] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1a36d99-a044-4987-8943-d83852cf66f8 is going to be updated. [ 1306.092287] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.092537] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.092537] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.092718] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.092860] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.102204] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: IN_PROGRESS for 2s [ 1306.917373] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2880c629-d8d0-45b5-b939-d99c78caab70 in Status: SUCCESS [ 1306.917650] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2880c629-d8d0-45b5-b939-d99c78caab70 deletion is rescheduled due to dependency. [ 1306.917730] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2880c629-d8d0-45b5-b939-d99c78caab70" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.111888] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: SUCCESS [ 1308.112271] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.112271] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.112534] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.112813] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.112940] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.113015] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.113176] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.113260] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.113347] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.113440] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.616311] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.616547] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.616547] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.616726] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.616906] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.617038] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.617100] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.617297] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.617400] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.617494] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.617650] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.617743] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.617804] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.617962] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.618157] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.618277] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.618335] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.618487] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.618564] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.618648] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.618743] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.121612] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b1a36d99-a044-4987-8943-d83852cf66f8: rpc.has_security_group_logging(os_id): False [ 1309.140898] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.140898] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.140898] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.141136] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.141136] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.141373] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.141489] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.141552] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.141709] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.141787] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.141979] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.142096] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.142170] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.142331] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.142412] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.142600] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.142694] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.142756] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.142893] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.142968] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.143086] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1a36d99-a044-4987-8943-d83852cf66f8 is going to be updated. [ 1309.204831] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.205027] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.205072] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.205278] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.205425] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.220841] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: IN_PROGRESS for 2s [ 1309.355690] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1309.355887] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1311.239050] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: SUCCESS [ 1311.239473] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.356422] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1314.356782] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1314.720185] env[65943]: INFO networking_nsxv3.common.synchronization [req-9be1a677-56c5-4513-aa30-1412b4f1992a req-8b884719-f673-4776-b7cc-f9c828e0b0c4 tempest-AttachVolumeNegativeTest-962354070 tempest-AttachVolumeNegativeTest-962354070-project-member] Enqueued Resource ID: 915457aa-a06c-4d08-af98-1cbce6ae4112 with Priority: HIGHEST for action security_group_members [ 1314.720786] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 915457aa-a06c-4d08-af98-1cbce6ae4112 with Priority: HIGHEST for action security_group_members [ 1314.721178] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-915457aa-a06c-4d08-af98-1cbce6ae4112 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.721296] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-915457aa-a06c-4d08-af98-1cbce6ae4112" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.721410] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-915457aa-a06c-4d08-af98-1cbce6ae4112" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.721636] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-915457aa-a06c-4d08-af98-1cbce6ae4112" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.721845] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.721976] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.722097] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.722287] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.722399] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.722514] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('915457aa-a06c-4d08-af98-1cbce6ae4112',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.224585] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.224793] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.224793] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.225059] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.225196] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.225430] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.226059] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.226059] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.226059] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.226059] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.226059] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 915457aa-a06c-4d08-af98-1cbce6ae4112 is going to be updated. [ 1315.254745] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.254964] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.255032] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.255284] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.255460] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.264430] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 915457aa-a06c-4d08-af98-1cbce6ae4112 in Status: IN_PROGRESS for 2s [ 1317.004092] env[65943]: INFO networking_nsxv3.common.synchronization [req-7da71f31-e9bd-4407-a8c6-e45fa85bc0ad req-852ae686-347d-43cc-8149-7c984583e144 tempest-ServersTestJSON-746248001 tempest-ServersTestJSON-746248001-project-member] Enqueued Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1317.005442] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1317.005442] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.005442] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.005635] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.005837] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.006079] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.006406] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.006406] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.006522] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.006610] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.006727] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.275340] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 915457aa-a06c-4d08-af98-1cbce6ae4112 in Status: SUCCESS [ 1317.286558] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 915457aa-a06c-4d08-af98-1cbce6ae4112 deletion is rescheduled due to dependency. [ 1317.286558] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-915457aa-a06c-4d08-af98-1cbce6ae4112" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.289812] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-928 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.290026] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-928" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.290248] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-928" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.290651] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-928" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.291009] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.291315] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.291552] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.291806] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.291958] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.292430] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1317.292430] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1317.292430] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1317.292648] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1317.292648] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1317.292766] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1317.292830] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1317.310207] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1317.310396] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1317.310535] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1317.310701] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-928" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.311012] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-dc94245f-632b-412f-8ec1-60b00c428c04 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.311188] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-dc94245f-632b-412f-8ec1-60b00c428c04" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.311315] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-dc94245f-632b-412f-8ec1-60b00c428c04" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.311635] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-dc94245f-632b-412f-8ec1-60b00c428c04" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.311777] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc94245f-632b-412f-8ec1-60b00c428c04',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.509406] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.814419] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.814689] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.814852] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.815226] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.815421] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.815623] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port dc94245f-632b-412f-8ec1-60b00c428c04 not found, creating... [ 1317.815909] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.816146] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.816267] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.817019] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.817019] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.817019] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.817203] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.817203] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.817418] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.817556] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.817693] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: dc94245f-632b-412f-8ec1-60b00c428c04 is going to be created. [ 1317.836680] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.836875] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.836996] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.837275] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.837507] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.837720] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-dc94245f-632b-412f-8ec1-60b00c428c04" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.012110] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.514670] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.514888] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.514888] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.515127] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.515223] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.515323] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1a36d99-a044-4987-8943-d83852cf66f8 is going to be updated. [ 1318.545436] env[65943]: INFO networking_nsxv3.common.synchronization [req-7da71f31-e9bd-4407-a8c6-e45fa85bc0ad req-76077173-3c5f-4a59-943d-d00f06a462c5 service nova] Enqueued Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_rules [ 1318.545932] env[65943]: INFO networking_nsxv3.common.synchronization [req-7da71f31-e9bd-4407-a8c6-e45fa85bc0ad req-76077173-3c5f-4a59-943d-d00f06a462c5 service nova] Enqueued Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1318.546143] env[65943]: INFO networking_nsxv3.common.synchronization [req-7da71f31-e9bd-4407-a8c6-e45fa85bc0ad req-76077173-3c5f-4a59-943d-d00f06a462c5 service nova] Enqueued Resource ID: dc94245f-632b-412f-8ec1-60b00c428c04 with Priority: HIGHEST for action port [ 1318.547703] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.547887] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.548011] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.548275] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.548447] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.550660] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_rules [ 1318.550849] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1318.550929] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc94245f-632b-412f-8ec1-60b00c428c04 with Priority: HIGHEST for action port [ 1318.551191] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.551341] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.551417] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.551614] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.551666] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.553052] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.553052] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.553190] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc94245f-632b-412f-8ec1-60b00c428c04 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.553281] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc94245f-632b-412f-8ec1-60b00c428c04" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.553281] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc94245f-632b-412f-8ec1-60b00c428c04" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.553442] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc94245f-632b-412f-8ec1-60b00c428c04" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.553535] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc94245f-632b-412f-8ec1-60b00c428c04',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.578286] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: IN_PROGRESS for 2s [ 1319.056027] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dc94245f-632b-412f-8ec1-60b00c428c04 with status ACTIVE [ 1319.056314] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.056437] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.056480] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.056694] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.056784] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.056964] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.057076] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.057132] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.057286] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.057364] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.057544] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.057636] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.057695] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.057855] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.057930] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.058026] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dc94245f-632b-412f-8ec1-60b00c428c04 is going to be updated. [ 1319.059232] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.059323] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.083362] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.083602] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.083602] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.083827] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.083919] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.084072] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc94245f-632b-412f-8ec1-60b00c428c04" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.589953] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: SUCCESS [ 1320.590471] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.590471] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.590611] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.590820] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.590942] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.591017] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.591195] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.591273] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.591393] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.093417] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.595910] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.097951] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.098165] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.098219] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.098421] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.098515] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.098611] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1a36d99-a044-4987-8943-d83852cf66f8 is going to be updated. [ 1322.126064] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.126258] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.126330] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.126545] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.126694] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.134973] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: IN_PROGRESS for 2s [ 1323.551836] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1323.552146] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1324.146018] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: SUCCESS [ 1324.146264] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.146491] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.146752] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.146909] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.147045] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.147117] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.147270] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.147350] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.147449] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.147537] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.650361] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.650709] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.650709] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.650815] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.650988] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.651101] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.651163] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.651329] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.651446] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.651493] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.651628] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.651718] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.651778] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.651915] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.652063] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.652153] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.652211] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.652344] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.652419] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.652497] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.652711] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.157142] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b1a36d99-a044-4987-8943-d83852cf66f8: rpc.has_security_group_logging(os_id): False [ 1325.176981] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.177235] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.177235] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.177414] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.177505] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.177702] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.177816] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.177868] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.178015] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.178100] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.178313] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.178405] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.178456] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.178602] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.178676] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.178866] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.178958] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.179029] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.179169] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.179241] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.179346] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1a36d99-a044-4987-8943-d83852cf66f8 is going to be updated. [ 1325.246035] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.246271] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.246321] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.246582] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.246764] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.279454] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: IN_PROGRESS for 2s [ 1327.297089] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: SUCCESS [ 1327.297418] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.725189] env[65943]: INFO networking_nsxv3.common.synchronization [req-63b2c4ad-fd53-4148-b152-5e7145360974 req-98928718-ac3a-4961-a885-3041ada08710 tempest-AttachVolumeNegativeTest-962354070 tempest-AttachVolumeNegativeTest-962354070-project-member] Enqueued Resource ID: 9ec3969d-7444-46cd-8273-33276cfbb49e with Priority: HIGHEST for action security_group_members [ 1327.725854] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ec3969d-7444-46cd-8273-33276cfbb49e with Priority: HIGHEST for action security_group_members [ 1327.726166] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ec3969d-7444-46cd-8273-33276cfbb49e taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.726361] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ec3969d-7444-46cd-8273-33276cfbb49e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.726422] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ec3969d-7444-46cd-8273-33276cfbb49e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.726577] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ec3969d-7444-46cd-8273-33276cfbb49e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.726739] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.726840] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.726899] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.727068] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.727198] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.727291] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ec3969d-7444-46cd-8273-33276cfbb49e',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.230267] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.230486] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.230543] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.230734] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.256535] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.256797] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.256915] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.256981] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.257207] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.257293] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.257384] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ec3969d-7444-46cd-8273-33276cfbb49e is going to be updated. [ 1328.284200] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.284422] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.284422] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.284614] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.284760] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.292935] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ec3969d-7444-46cd-8273-33276cfbb49e in Status: IN_PROGRESS for 2s [ 1329.338638] env[65943]: INFO networking_nsxv3.common.synchronization [req-416d863f-bfe7-455b-8b4b-672fb0e59ecf req-46f2e128-112b-4588-9997-561b4a0ce00c tempest-ServersTestJSON-746248001 tempest-ServersTestJSON-746248001-project-member] Enqueued Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1329.338842] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1329.339210] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.339460] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.339460] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.340083] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.340083] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.340083] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.340083] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.340282] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.340282] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.340474] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.841949] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.303612] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ec3969d-7444-46cd-8273-33276cfbb49e in Status: SUCCESS [ 1330.303799] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ec3969d-7444-46cd-8273-33276cfbb49e deletion is rescheduled due to dependency. [ 1330.303896] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ec3969d-7444-46cd-8273-33276cfbb49e" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.344399] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.847558] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.847720] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.847835] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.848013] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.848116] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.848231] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1a36d99-a044-4987-8943-d83852cf66f8 is going to be updated. [ 1330.880649] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.880820] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.880872] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.881072] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.881224] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.892146] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: IN_PROGRESS for 2s [ 1331.855481] env[65943]: INFO networking_nsxv3.common.synchronization [None req-2ad34801-5b42-4d6c-9165-b5faf569d5ad tempest-AttachVolumeNegativeTest-962354070 tempest-AttachVolumeNegativeTest-962354070-project-member] Enqueued Resource ID: 6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319 with Priority: HIGHEST for action security_group_rules [ 1331.856015] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319 with Priority: HIGHEST for action security_group_rules [ 1331.856335] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.856471] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.856542] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.856799] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.856881] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.936168] env[65943]: INFO networking_nsxv3.common.synchronization [None req-a673d17b-ea1b-4d2c-ad92-f88096dd963f tempest-AttachVolumeNegativeTest-962354070 tempest-AttachVolumeNegativeTest-962354070-project-member] Enqueued Resource ID: 6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319 with Priority: HIGHEST for action security_group_rules [ 1331.936964] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319 with Priority: HIGHEST for action security_group_rules [ 1331.937286] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.937388] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.377033] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.377033] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.377033] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.377304] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.377304] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.377365] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319 already deleted. [ 1332.377412] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.377539] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.377691] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.377776] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.900407] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.900801] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.900801] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.900801] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.900922] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.900953] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319 already deleted. [ 1332.901054] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.901935] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: SUCCESS [ 1332.902191] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.950600] env[65943]: INFO networking_nsxv3.common.synchronization [req-3f057cc5-adc5-404f-8c98-e590c863976e req-23798c23-daa8-48bd-a0b7-31aefefb40bc tempest-ServersTestJSON-746248001 tempest-ServersTestJSON-746248001-project-member] Enqueued Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1335.950812] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1335.951022] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.951657] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.951657] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.951657] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.951657] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.951657] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.951657] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.951953] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.951953] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.952084] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.455537] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.957755] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.278322] env[65943]: INFO networking_nsxv3.common.synchronization [req-789d96ab-63d0-413e-910f-51ff1c4f9b67 req-f9d5a72a-1cb9-4de7-a45a-4ffb53caaa9f tempest-AttachVolumeNegativeTest-962354070 tempest-AttachVolumeNegativeTest-962354070-project-member] Enqueued Resource ID: 6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319 with Priority: HIGHEST for action security_group_members [ 1337.278749] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319 with Priority: HIGHEST for action security_group_members [ 1337.279113] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.279268] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.279359] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.279867] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.279867] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.279956] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.280060] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.280211] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.280350] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.280452] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.460696] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.460939] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.460939] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.461259] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.461383] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.461549] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1a36d99-a044-4987-8943-d83852cf66f8 is going to be updated. [ 1337.497658] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.498028] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.498212] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.498531] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.498744] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.509521] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: IN_PROGRESS for 2s [ 1337.588348] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-94 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.588348] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-94" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.588597] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-94" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.588881] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-94" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.589337] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.589942] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.590142] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.590446] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.590751] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.591119] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1337.591292] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1337.591541] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1337.591709] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1337.591961] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1337.592127] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1337.592413] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1337.615439] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1337.615713] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1337.615899] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1337.616161] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-94" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.616567] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-9d00f1d7-c3dc-4be8-93d6-efbde04dfc8c taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.616812] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-9d00f1d7-c3dc-4be8-93d6-efbde04dfc8c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.616961] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-9d00f1d7-c3dc-4be8-93d6-efbde04dfc8c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.617362] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-9d00f1d7-c3dc-4be8-93d6-efbde04dfc8c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.617539] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d00f1d7-c3dc-4be8-93d6-efbde04dfc8c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.782224] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.782450] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.782450] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.782658] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.782750] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.782946] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.783059] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.783121] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.783272] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.783350] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.783430] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319 already deleted. [ 1337.783630] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.120671] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.121030] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.121030] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.121347] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.121526] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.121683] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port 9d00f1d7-c3dc-4be8-93d6-efbde04dfc8c not found, creating... [ 1338.121997] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.122144] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.122274] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.122486] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.122622] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.122900] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.123062] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.123178] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.123383] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.123527] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.123735] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: 9d00f1d7-c3dc-4be8-93d6-efbde04dfc8c is going to be created. [ 1338.144670] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.144931] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.145069] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.145359] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.145586] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.145826] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-9d00f1d7-c3dc-4be8-93d6-efbde04dfc8c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.823948] env[65943]: INFO networking_nsxv3.common.synchronization [req-6c845a54-dd25-4e61-9a1f-231c16d6c42a req-b6084017-133f-40a0-af15-6e8c5fc30de0 tempest-AttachVolumeTestJSON-1035762737 tempest-AttachVolumeTestJSON-1035762737-project-member] Enqueued Resource ID: 036b36e3-f557-44a3-a77b-61a8567a6143 with Priority: HIGHEST for action security_group_members [ 1338.824555] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 036b36e3-f557-44a3-a77b-61a8567a6143 with Priority: HIGHEST for action security_group_members [ 1338.824870] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-036b36e3-f557-44a3-a77b-61a8567a6143 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.824998] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-036b36e3-f557-44a3-a77b-61a8567a6143" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.825080] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-036b36e3-f557-44a3-a77b-61a8567a6143" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.825288] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-036b36e3-f557-44a3-a77b-61a8567a6143" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.825451] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.825551] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.825613] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.825770] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.825854] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.825948] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('036b36e3-f557-44a3-a77b-61a8567a6143',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.856037] env[65943]: INFO networking_nsxv3.common.synchronization [req-789d96ab-63d0-413e-910f-51ff1c4f9b67 req-c45fd261-a30d-4a10-9bb4-c4dded95e75f service nova] Enqueued Resource ID: 6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319 with Priority: HIGHEST for action security_group_rules [ 1338.856222] env[65943]: INFO networking_nsxv3.common.synchronization [req-789d96ab-63d0-413e-910f-51ff1c4f9b67 req-c45fd261-a30d-4a10-9bb4-c4dded95e75f service nova] Enqueued Resource ID: 6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319 with Priority: HIGHEST for action security_group_members [ 1338.856365] env[65943]: INFO networking_nsxv3.common.synchronization [req-789d96ab-63d0-413e-910f-51ff1c4f9b67 req-c45fd261-a30d-4a10-9bb4-c4dded95e75f service nova] Enqueued Resource ID: 9d00f1d7-c3dc-4be8-93d6-efbde04dfc8c with Priority: HIGHEST for action port [ 1338.856590] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319 with Priority: HIGHEST for action security_group_rules [ 1338.856734] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319 with Priority: HIGHEST for action security_group_members [ 1338.856830] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d00f1d7-c3dc-4be8-93d6-efbde04dfc8c with Priority: HIGHEST for action port [ 1338.857614] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.857720] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.857792] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.858052] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.858152] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.858993] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.859117] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.859183] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.859356] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.859498] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.859590] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.859652] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.859791] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.859879] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.859966] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.860726] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d00f1d7-c3dc-4be8-93d6-efbde04dfc8c taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.860827] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d00f1d7-c3dc-4be8-93d6-efbde04dfc8c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.860875] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d00f1d7-c3dc-4be8-93d6-efbde04dfc8c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.863974] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d00f1d7-c3dc-4be8-93d6-efbde04dfc8c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.864121] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d00f1d7-c3dc-4be8-93d6-efbde04dfc8c',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.328266] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.329270] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.329270] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.329270] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.329270] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.329486] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.329486] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.329573] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.329666] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.329741] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.329826] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 036b36e3-f557-44a3-a77b-61a8567a6143 is going to be updated. [ 1339.356114] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.356297] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.356343] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.356516] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.356661] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.365309] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.366845] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.366845] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.367762] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 036b36e3-f557-44a3-a77b-61a8567a6143 in Status: IN_PROGRESS for 2s [ 1339.368144] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9d00f1d7-c3dc-4be8-93d6-efbde04dfc8c with status ACTIVE [ 1339.368263] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.368426] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.368597] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.368821] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.368913] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.369115] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.369223] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.369288] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.369480] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.369525] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.369697] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.369793] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.369856] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.369993] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.370081] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.370559] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9d00f1d7-c3dc-4be8-93d6-efbde04dfc8c is going to be updated. [ 1339.394027] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.394027] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.394027] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.394027] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.394027] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.394027] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d00f1d7-c3dc-4be8-93d6-efbde04dfc8c" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.522650] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: SUCCESS [ 1339.522880] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.868519] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.371427] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.371717] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.371806] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.372075] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.372189] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.372326] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319 is going to be created. [ 1340.400678] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.400802] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.400888] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.401101] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.401262] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.411288] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319 in Status: UNINITIALIZED for 2s [ 1341.377631] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 036b36e3-f557-44a3-a77b-61a8567a6143 in Status: SUCCESS [ 1341.378034] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 036b36e3-f557-44a3-a77b-61a8567a6143 deletion is rescheduled due to dependency. [ 1341.378034] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-036b36e3-f557-44a3-a77b-61a8567a6143" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.420485] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319 in Status: SUCCESS [ 1342.420865] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.420979] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.421142] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.421344] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.421465] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.421537] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.421699] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.421787] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.421870] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.421966] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.924068] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.427053] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319: rpc.has_security_group_logging(os_id): False [ 1343.445536] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.445809] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.445995] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.446453] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.446648] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.447833] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.447833] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.447833] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.447993] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.448203] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.448365] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319 is going to be created. [ 1343.530282] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.530484] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.530554] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.530844] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.531128] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.543617] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319 in Status: IN_PROGRESS for 2s [ 1343.857737] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1343.857908] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1345.243145] env[65943]: INFO networking_nsxv3.common.synchronization [req-c23c690e-92b9-460d-ac9f-5dcbcddffe58 req-6c725343-ff51-423a-9d3f-1ae21a4c6425 tempest-ServersTestJSON-746248001 tempest-ServersTestJSON-746248001-project-member] Enqueued Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1345.243724] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1345.243993] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.244301] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.244378] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.244615] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.244835] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.244919] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.244960] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.245129] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.245215] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.245312] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.545312] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-928 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.545574] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-928" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.545723] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-928" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.546012] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-928" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.546286] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.546447] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.546578] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.546799] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.546948] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.547176] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1345.547284] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1345.547393] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1345.547498] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1345.547601] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1345.547704] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1345.547835] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1345.567611] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319 in Status: SUCCESS [ 1345.567869] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.575945] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1345.576181] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1345.576318] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1345.576516] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-928" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.576872] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-9b2e0f38-99ab-4f7d-b9e2-de9faa7d9f8b taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.577105] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-9b2e0f38-99ab-4f7d-b9e2-de9faa7d9f8b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.577393] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-9b2e0f38-99ab-4f7d-b9e2-de9faa7d9f8b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.577637] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-9b2e0f38-99ab-4f7d-b9e2-de9faa7d9f8b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.577859] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b2e0f38-99ab-4f7d-b9e2-de9faa7d9f8b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.748022] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.079943] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.080204] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.080333] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.080696] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.080845] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.081007] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port 9b2e0f38-99ab-4f7d-b9e2-de9faa7d9f8b not found, creating... [ 1346.081527] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.081527] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.081673] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.081823] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.081954] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.082270] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.082425] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.082584] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.082807] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.082940] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.083088] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: 9b2e0f38-99ab-4f7d-b9e2-de9faa7d9f8b is going to be created. [ 1346.107794] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.107966] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.107966] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.108535] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.108786] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.109040] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-9b2e0f38-99ab-4f7d-b9e2-de9faa7d9f8b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.251131] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.753689] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.753884] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.753963] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.754233] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.754341] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.754450] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1a36d99-a044-4987-8943-d83852cf66f8 is going to be updated. [ 1346.796228] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.796466] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.796466] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.796623] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.796769] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.807164] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: IN_PROGRESS for 2s [ 1346.845032] env[65943]: INFO networking_nsxv3.common.synchronization [req-c23c690e-92b9-460d-ac9f-5dcbcddffe58 req-000fb2fe-7131-4202-98eb-9c3e1cc314ae service nova] Enqueued Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_rules [ 1346.845244] env[65943]: INFO networking_nsxv3.common.synchronization [req-c23c690e-92b9-460d-ac9f-5dcbcddffe58 req-000fb2fe-7131-4202-98eb-9c3e1cc314ae service nova] Enqueued Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1346.845434] env[65943]: INFO networking_nsxv3.common.synchronization [req-c23c690e-92b9-460d-ac9f-5dcbcddffe58 req-000fb2fe-7131-4202-98eb-9c3e1cc314ae service nova] Enqueued Resource ID: 9b2e0f38-99ab-4f7d-b9e2-de9faa7d9f8b with Priority: HIGHEST for action port [ 1346.846188] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_rules [ 1346.846188] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1346.846417] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b2e0f38-99ab-4f7d-b9e2-de9faa7d9f8b with Priority: HIGHEST for action port [ 1346.846762] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.847016] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.847083] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.847418] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.847458] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.848879] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.848879] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.849154] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b2e0f38-99ab-4f7d-b9e2-de9faa7d9f8b taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.849246] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b2e0f38-99ab-4f7d-b9e2-de9faa7d9f8b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.849246] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b2e0f38-99ab-4f7d-b9e2-de9faa7d9f8b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.849487] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b2e0f38-99ab-4f7d-b9e2-de9faa7d9f8b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.849558] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b2e0f38-99ab-4f7d-b9e2-de9faa7d9f8b',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.351836] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.351836] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.352259] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9b2e0f38-99ab-4f7d-b9e2-de9faa7d9f8b with status ACTIVE [ 1347.352259] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.352393] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.352393] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.352741] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.352741] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.353085] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.353208] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.353270] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.353467] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.353560] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.353770] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.353879] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.353944] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.354140] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.354409] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.354573] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9b2e0f38-99ab-4f7d-b9e2-de9faa7d9f8b is going to be updated. [ 1347.380966] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.381207] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.381207] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.381386] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.381565] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.381728] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b2e0f38-99ab-4f7d-b9e2-de9faa7d9f8b" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.818266] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: SUCCESS [ 1348.818591] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.818826] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.819111] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.819342] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.819511] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.819588] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.819792] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.819871] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.820054] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.322867] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.826305] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.329018] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.329224] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.329293] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.329485] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.329576] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.329682] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1a36d99-a044-4987-8943-d83852cf66f8 is going to be updated. [ 1350.378244] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.378457] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.378457] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.378668] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.378823] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.398119] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: IN_PROGRESS for 2s [ 1351.847856] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1351.848299] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1352.409141] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: SUCCESS [ 1352.409372] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.409629] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.409877] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.410117] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.410264] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.410354] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.410592] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.410692] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.410783] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.410876] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1352.913398] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.913741] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.913741] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.913835] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.913996] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.914143] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.914210] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.914367] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.914456] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.914545] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.914696] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.914789] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.914851] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.914991] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.915143] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.915234] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.915292] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.915429] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.915502] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.915584] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.915670] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.417964] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b1a36d99-a044-4987-8943-d83852cf66f8: rpc.has_security_group_logging(os_id): False [ 1353.438031] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.438259] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.438348] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.438655] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.438764] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.438899] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.439222] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.439222] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.439350] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.439350] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.439605] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.439757] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.439839] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.440393] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.440618] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.440858] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.440972] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.441056] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.441255] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.441356] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.441448] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1a36d99-a044-4987-8943-d83852cf66f8 is going to be updated. [ 1353.505591] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.505798] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.505798] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.506014] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.506160] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.521801] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: IN_PROGRESS for 2s [ 1355.539048] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: SUCCESS [ 1355.539443] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.849515] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1356.849515] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1357.856158] env[65943]: INFO networking_nsxv3.common.synchronization [req-a9bf3915-07ed-4f27-b111-90724c81bd2c req-2e42cea1-6287-456a-b394-ab452da1cd24 tempest-ServersTestJSON-746248001 tempest-ServersTestJSON-746248001-project-member] Enqueued Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1357.856961] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1357.856961] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.857149] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.857191] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.857470] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.857681] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.857836] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.857911] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.858081] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.858169] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.858263] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.359917] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.862517] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.365385] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.365603] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.365653] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.365882] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.366067] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.366164] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1a36d99-a044-4987-8943-d83852cf66f8 is going to be updated. [ 1359.395643] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.395852] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.395852] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.396080] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.396233] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.406021] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: IN_PROGRESS for 2s [ 1361.417074] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: SUCCESS [ 1361.417522] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.857403] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1362.857692] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1367.027138] env[65943]: INFO networking_nsxv3.common.synchronization [req-f2b4190a-4061-422a-9042-20e81c0768f8 req-76081107-16a7-4bde-88b6-febb093f3020 tempest-ServersTestJSON-746248001 tempest-ServersTestJSON-746248001-project-member] Enqueued Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1367.027138] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1367.027138] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.027138] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.027138] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.027138] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.027138] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.027138] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.027138] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.027138] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.027138] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.027138] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.309901] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-928 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.310147] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-928" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.310289] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-928" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.310737] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-928" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.310837] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.310995] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.311665] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.311665] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.311665] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.311665] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1367.311968] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1367.311968] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1367.311968] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1367.312167] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1367.312245] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1367.312320] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1367.332898] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1367.333063] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1367.333200] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1367.333376] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-928" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.333682] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-1df111f9-a41c-4420-8b2d-c7551835e769 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.333849] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-1df111f9-a41c-4420-8b2d-c7551835e769" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.333967] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-1df111f9-a41c-4420-8b2d-c7551835e769" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.334305] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-1df111f9-a41c-4420-8b2d-c7551835e769" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.334443] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1df111f9-a41c-4420-8b2d-c7551835e769',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.528931] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.837035] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.837399] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.837399] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.837670] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.837847] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.838019] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port 1df111f9-a41c-4420-8b2d-c7551835e769 not found, creating... [ 1367.838280] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.838433] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.838546] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.838776] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.838913] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.839203] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.839354] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.839468] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.839669] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.839801] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.839932] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: 1df111f9-a41c-4420-8b2d-c7551835e769 is going to be created. [ 1367.860381] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.860586] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.860709] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.860951] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.861200] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.861413] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-1df111f9-a41c-4420-8b2d-c7551835e769" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.031472] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.534365] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.534610] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.534711] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.535007] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.535147] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.535278] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1a36d99-a044-4987-8943-d83852cf66f8 is going to be updated. [ 1368.561496] env[65943]: INFO networking_nsxv3.common.synchronization [req-f2b4190a-4061-422a-9042-20e81c0768f8 req-fb283d58-b2d8-44f4-b5d8-2d2dda19323f service nova] Enqueued Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_rules [ 1368.561843] env[65943]: INFO networking_nsxv3.common.synchronization [req-f2b4190a-4061-422a-9042-20e81c0768f8 req-fb283d58-b2d8-44f4-b5d8-2d2dda19323f service nova] Enqueued Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1368.562113] env[65943]: INFO networking_nsxv3.common.synchronization [req-f2b4190a-4061-422a-9042-20e81c0768f8 req-fb283d58-b2d8-44f4-b5d8-2d2dda19323f service nova] Enqueued Resource ID: 1df111f9-a41c-4420-8b2d-c7551835e769 with Priority: HIGHEST for action port [ 1368.562883] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_rules [ 1368.563096] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1368.563258] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1df111f9-a41c-4420-8b2d-c7551835e769 with Priority: HIGHEST for action port [ 1368.564636] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.564853] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.564988] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.565300] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.565524] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.566940] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.567159] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.567277] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.567527] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.567793] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.569343] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.569476] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.569747] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-1df111f9-a41c-4420-8b2d-c7551835e769 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.569904] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1df111f9-a41c-4420-8b2d-c7551835e769" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.569994] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1df111f9-a41c-4420-8b2d-c7551835e769" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.570214] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1df111f9-a41c-4420-8b2d-c7551835e769" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.570482] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1df111f9-a41c-4420-8b2d-c7551835e769',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.581810] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: IN_PROGRESS for 2s [ 1369.072984] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.073428] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.073428] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1df111f9-a41c-4420-8b2d-c7551835e769 with status ACTIVE [ 1369.073531] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.073594] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.073655] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.073857] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.073990] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.074121] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.074216] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.074270] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.074428] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.074507] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.074687] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.074778] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.074840] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.074976] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.075062] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.075145] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1df111f9-a41c-4420-8b2d-c7551835e769 is going to be updated. [ 1369.095424] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.095612] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.095612] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.095777] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.095912] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.096080] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1df111f9-a41c-4420-8b2d-c7551835e769" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.591071] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: SUCCESS [ 1370.591071] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.591497] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.591497] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.591606] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.591758] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.591801] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.591974] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.592043] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.592127] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1371.094434] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1371.596805] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1372.099351] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.099573] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.099573] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.099816] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.099910] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.100020] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1a36d99-a044-4987-8943-d83852cf66f8 is going to be updated. [ 1372.129927] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.130161] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.130161] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.130383] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.130547] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.140026] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: IN_PROGRESS for 2s [ 1373.564877] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1373.565246] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1374.151778] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: SUCCESS [ 1374.152065] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.152241] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.152497] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.152714] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.152845] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.152908] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.153110] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.153192] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.153301] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.153411] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1374.656030] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.656452] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.656452] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.656452] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.656656] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.656757] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.656819] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.656971] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.657072] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.657161] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.657308] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.657401] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.657462] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.657603] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.657742] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.657835] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.657894] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.658040] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.658117] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.658199] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.658286] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1375.161186] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b1a36d99-a044-4987-8943-d83852cf66f8: rpc.has_security_group_logging(os_id): False [ 1375.178166] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.178360] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.178360] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.178568] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.178678] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.178837] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.178936] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.178993] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.179153] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.179228] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.179421] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.179506] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.179560] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.179733] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.179812] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.180029] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.180158] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.180158] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.180297] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.180365] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.180448] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1a36d99-a044-4987-8943-d83852cf66f8 is going to be updated. [ 1375.239879] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.240230] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.240230] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.240339] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.240453] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.252338] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: IN_PROGRESS for 2s [ 1377.269173] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: SUCCESS [ 1377.269619] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.565770] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1378.566132] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1381.532865] env[65943]: INFO networking_nsxv3.common.synchronization [req-1d436023-96a9-4f26-bb91-3f3f36cae505 req-c2e5ce9b-7e66-47bf-a0c2-67f0105bb7cf tempest-ServersTestJSON-746248001 tempest-ServersTestJSON-746248001-project-member] Enqueued Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1381.533305] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1381.533876] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.534015] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.534078] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.534276] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.534596] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.534596] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.534596] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.534788] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.534837] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.534899] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1382.037563] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1382.539795] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.042355] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.042520] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.042613] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.042801] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.042895] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.043032] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1a36d99-a044-4987-8943-d83852cf66f8 is going to be updated. [ 1383.073343] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.073573] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.073675] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.073985] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.074229] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.086600] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: IN_PROGRESS for 2s [ 1385.098240] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: SUCCESS [ 1385.098509] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.534461] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1386.534927] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1387.833227] env[65943]: INFO networking_nsxv3.common.synchronization [req-2260e2eb-4f15-4d46-b49b-d041fee6b8ec req-1acf869d-0271-41f0-9cdc-0908479358b3 tempest-ServersTestJSON-746248001 tempest-ServersTestJSON-746248001-project-member] Enqueued Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1387.833806] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a36d99-a044-4987-8943-d83852cf66f8 with Priority: HIGHEST for action security_group_members [ 1387.834428] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a36d99-a044-4987-8943-d83852cf66f8 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.834428] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.834428] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.834622] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.835017] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.835130] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.835198] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.835362] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.835448] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.835543] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1a36d99-a044-4987-8943-d83852cf66f8',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.337564] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.337817] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.337817] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.338065] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.338170] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.338445] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.338551] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.338625] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.338852] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.338967] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.339040] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1a36d99-a044-4987-8943-d83852cf66f8 is going to be updated. [ 1388.371942] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.372168] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.372168] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.372370] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.372535] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.381255] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: IN_PROGRESS for 2s [ 1390.392279] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a36d99-a044-4987-8943-d83852cf66f8 in Status: SUCCESS [ 1390.392700] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1a36d99-a044-4987-8943-d83852cf66f8 deletion is rescheduled due to dependency. [ 1390.392700] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a36d99-a044-4987-8943-d83852cf66f8" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.835236] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1392.835538] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1397.836831] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1397.837247] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1400.986050] env[65943]: INFO networking_nsxv3.common.synchronization [req-009bcbc7-a522-4766-a4aa-8746c881c21e req-d35b2da1-36d5-49f0-884f-82abf29d9f51 tempest-AttachVolumeNegativeTest-962354070 tempest-AttachVolumeNegativeTest-962354070-project-member] Enqueued Resource ID: 6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319 with Priority: HIGHEST for action security_group_members [ 1400.986601] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319 with Priority: HIGHEST for action security_group_members [ 1400.987164] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.987308] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.987379] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.987571] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.987742] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.987827] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.987878] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.988034] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.988124] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.988217] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1401.491117] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.491117] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.491117] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.491117] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.491606] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.491606] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.491606] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.491606] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.491835] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.491835] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.491835] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319 is going to be updated. [ 1401.520350] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.520574] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.520574] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.520819] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.520937] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.529083] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319 in Status: IN_PROGRESS for 2s [ 1403.540396] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319 in Status: SUCCESS [ 1403.540796] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319 deletion is rescheduled due to dependency. [ 1403.540796] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e9e6b52-d75e-4c89-a9a1-ce74b2dd7319" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.666413] env[65943]: INFO networking_nsxv3.common.synchronization [None req-46612044-bd9e-4902-9cac-5ef42d491d30 tempest-AttachVolumeNegativeTest-962354070 tempest-AttachVolumeNegativeTest-962354070-project-member] Enqueued Resource ID: e7ac51ce-a3d8-4ba8-9613-e65b6f4735db with Priority: HIGHEST for action security_group_rules [ 1405.666806] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7ac51ce-a3d8-4ba8-9613-e65b6f4735db with Priority: HIGHEST for action security_group_rules [ 1405.667124] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7ac51ce-a3d8-4ba8-9613-e65b6f4735db taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.667271] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7ac51ce-a3d8-4ba8-9613-e65b6f4735db" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.667339] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7ac51ce-a3d8-4ba8-9613-e65b6f4735db" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.667597] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7ac51ce-a3d8-4ba8-9613-e65b6f4735db" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.667682] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7ac51ce-a3d8-4ba8-9613-e65b6f4735db',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1405.773895] env[65943]: INFO networking_nsxv3.common.synchronization [None req-466cff45-52e0-4975-a038-cf71ce986269 tempest-AttachVolumeNegativeTest-962354070 tempest-AttachVolumeNegativeTest-962354070-project-member] Enqueued Resource ID: e7ac51ce-a3d8-4ba8-9613-e65b6f4735db with Priority: HIGHEST for action security_group_rules [ 1405.774194] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7ac51ce-a3d8-4ba8-9613-e65b6f4735db with Priority: HIGHEST for action security_group_rules [ 1405.774496] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7ac51ce-a3d8-4ba8-9613-e65b6f4735db taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.774599] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7ac51ce-a3d8-4ba8-9613-e65b6f4735db" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.189275] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.189373] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.189373] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.189577] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.189667] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.189763] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7ac51ce-a3d8-4ba8-9613-e65b6f4735db already deleted. [ 1406.189847] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7ac51ce-a3d8-4ba8-9613-e65b6f4735db" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.189995] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7ac51ce-a3d8-4ba8-9613-e65b6f4735db" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.190206] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7ac51ce-a3d8-4ba8-9613-e65b6f4735db" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.190292] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7ac51ce-a3d8-4ba8-9613-e65b6f4735db',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1406.711115] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.711542] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.711542] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.711542] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.711667] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.711667] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7ac51ce-a3d8-4ba8-9613-e65b6f4735db already deleted. [ 1406.711746] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7ac51ce-a3d8-4ba8-9613-e65b6f4735db" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.775322] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1410.775589] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1411.140765] env[65943]: INFO networking_nsxv3.common.synchronization [req-e441a393-fa7f-4019-8696-d7124d95005c req-55e77a58-e565-4166-9bfa-cfc09129a10d tempest-AttachVolumeNegativeTest-962354070 tempest-AttachVolumeNegativeTest-962354070-project-member] Enqueued Resource ID: e7ac51ce-a3d8-4ba8-9613-e65b6f4735db with Priority: HIGHEST for action security_group_members [ 1411.141352] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7ac51ce-a3d8-4ba8-9613-e65b6f4735db with Priority: HIGHEST for action security_group_members [ 1411.141661] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7ac51ce-a3d8-4ba8-9613-e65b6f4735db taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.141783] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7ac51ce-a3d8-4ba8-9613-e65b6f4735db" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.141853] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7ac51ce-a3d8-4ba8-9613-e65b6f4735db" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.142178] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7ac51ce-a3d8-4ba8-9613-e65b6f4735db" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.142339] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.142429] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.142492] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.142649] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.142733] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.142845] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7ac51ce-a3d8-4ba8-9613-e65b6f4735db',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.391982] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock network-94 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.392195] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "network-94" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.392323] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "network-94" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.392595] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "network-94" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.392863] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.393055] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.393176] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.393394] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.393540] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.393750] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1411.393863] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] NeedRegenerationException {{(pid=65943) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1411.393977] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] no value, waiting for create lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1411.394097] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] value creation lock acquired {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1411.394204] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] No value present for key: 'zone-id' {{(pid=65943) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1411.394308] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Calling creation function for not-yet-present value {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1411.394437] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1411.414459] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1411.414622] env[65943]: DEBUG dogpile.cache.region [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65943) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1411.414734] env[65943]: DEBUG dogpile.lock [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Released creation lock {{(pid=65943) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1411.414902] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "network-94" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.415216] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock port-d82d6b81-f33b-43c0-afbe-127863bed0e1 taken with stack trace [, , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.415382] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "port-d82d6b81-f33b-43c0-afbe-127863bed0e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.415499] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "port-d82d6b81-f33b-43c0-afbe-127863bed0e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.415801] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "port-d82d6b81-f33b-43c0-afbe-127863bed0e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.415941] env[65943]: DEBUG networking_nsxv3.api.rpc [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d82d6b81-f33b-43c0-afbe-127863bed0e1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.645729] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.645961] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.645961] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.646250] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.646352] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.646577] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.646683] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.646764] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.646920] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.647026] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.647121] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7ac51ce-a3d8-4ba8-9613-e65b6f4735db already deleted. [ 1411.647227] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7ac51ce-a3d8-4ba8-9613-e65b6f4735db" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.917951] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.918333] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.918333] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.918605] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.918755] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.918953] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Segment Port d82d6b81-f33b-43c0-afbe-127863bed0e1 not found, creating... [ 1411.919258] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.919417] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.919534] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.919755] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.919891] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.920185] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.920344] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.920459] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.920663] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.920795] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.920952] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Resource: SegmentPort with ID: d82d6b81-f33b-43c0-afbe-127863bed0e1 is going to be created. [ 1411.940380] env[65943]: DEBUG networking_nsxv3.common.locking [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.940592] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.940714] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.941014] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.941246] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.941478] env[65943]: DEBUG oslo_concurrency.lockutils [None req-980bac86-f4eb-4a3e-afdd-c6492d0ee7e0 None None] Releasing lock "port-d82d6b81-f33b-43c0-afbe-127863bed0e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.613163] env[65943]: INFO networking_nsxv3.common.synchronization [req-e441a393-fa7f-4019-8696-d7124d95005c req-d8daf1ff-0d5b-419b-9569-af71df0598b5 service nova] Enqueued Resource ID: e7ac51ce-a3d8-4ba8-9613-e65b6f4735db with Priority: HIGHEST for action security_group_rules [ 1412.613380] env[65943]: INFO networking_nsxv3.common.synchronization [req-e441a393-fa7f-4019-8696-d7124d95005c req-d8daf1ff-0d5b-419b-9569-af71df0598b5 service nova] Enqueued Resource ID: e7ac51ce-a3d8-4ba8-9613-e65b6f4735db with Priority: HIGHEST for action security_group_members [ 1412.613524] env[65943]: INFO networking_nsxv3.common.synchronization [req-e441a393-fa7f-4019-8696-d7124d95005c req-d8daf1ff-0d5b-419b-9569-af71df0598b5 service nova] Enqueued Resource ID: d82d6b81-f33b-43c0-afbe-127863bed0e1 with Priority: HIGHEST for action port [ 1412.613744] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7ac51ce-a3d8-4ba8-9613-e65b6f4735db with Priority: HIGHEST for action security_group_rules [ 1412.613878] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7ac51ce-a3d8-4ba8-9613-e65b6f4735db with Priority: HIGHEST for action security_group_members [ 1412.613976] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d82d6b81-f33b-43c0-afbe-127863bed0e1 with Priority: HIGHEST for action port [ 1412.614514] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7ac51ce-a3d8-4ba8-9613-e65b6f4735db taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.614642] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7ac51ce-a3d8-4ba8-9613-e65b6f4735db" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.614781] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7ac51ce-a3d8-4ba8-9613-e65b6f4735db" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.614941] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7ac51ce-a3d8-4ba8-9613-e65b6f4735db" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.614976] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7ac51ce-a3d8-4ba8-9613-e65b6f4735db',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1412.615917] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7ac51ce-a3d8-4ba8-9613-e65b6f4735db taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.616357] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7ac51ce-a3d8-4ba8-9613-e65b6f4735db" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.616796] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7ac51ce-a3d8-4ba8-9613-e65b6f4735db" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.617019] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7ac51ce-a3d8-4ba8-9613-e65b6f4735db" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.617616] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.617766] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.618379] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.618379] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.618379] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.618379] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7ac51ce-a3d8-4ba8-9613-e65b6f4735db',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1412.619393] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock port-d82d6b81-f33b-43c0-afbe-127863bed0e1 taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.619393] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d82d6b81-f33b-43c0-afbe-127863bed0e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.619393] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d82d6b81-f33b-43c0-afbe-127863bed0e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.619588] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d82d6b81-f33b-43c0-afbe-127863bed0e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.619695] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d82d6b81-f33b-43c0-afbe-127863bed0e1',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1413.122382] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e7ac51ce-a3d8-4ba8-9613-e65b6f4735db',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1413.124638] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7ac51ce-a3d8-4ba8-9613-e65b6f4735db taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.124755] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7ac51ce-a3d8-4ba8-9613-e65b6f4735db" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.125101] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d82d6b81-f33b-43c0-afbe-127863bed0e1 with status ACTIVE [ 1413.125266] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.125366] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.125428] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.125630] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.125722] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.125883] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.125979] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.126055] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.126201] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.126279] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.126455] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.126557] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.126657] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.126786] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.126855] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.126905] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d82d6b81-f33b-43c0-afbe-127863bed0e1 is going to be updated. [ 1413.146876] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.147215] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.147215] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.147318] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.147407] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.147564] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d82d6b81-f33b-43c0-afbe-127863bed0e1" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.626189] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e7ac51ce-a3d8-4ba8-9613-e65b6f4735db',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.129839] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.129839] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.129839] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.130407] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.130407] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.130407] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7ac51ce-a3d8-4ba8-9613-e65b6f4735db is going to be created. [ 1414.153731] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.153915] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.153967] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.154189] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.154344] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.162813] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7ac51ce-a3d8-4ba8-9613-e65b6f4735db in Status: UNINITIALIZED for 2s [ 1416.172995] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7ac51ce-a3d8-4ba8-9613-e65b6f4735db in Status: SUCCESS [ 1416.173411] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7ac51ce-a3d8-4ba8-9613-e65b6f4735db" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.173501] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7ac51ce-a3d8-4ba8-9613-e65b6f4735db" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.173724] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7ac51ce-a3d8-4ba8-9613-e65b6f4735db" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.173953] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.174120] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.174209] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.174399] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.174499] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.174608] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7ac51ce-a3d8-4ba8-9613-e65b6f4735db" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.174720] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e7ac51ce-a3d8-4ba8-9613-e65b6f4735db',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1416.677131] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e7ac51ce-a3d8-4ba8-9613-e65b6f4735db',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1417.180050] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e7ac51ce-a3d8-4ba8-9613-e65b6f4735db: rpc.has_security_group_logging(os_id): False [ 1417.196944] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.197139] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.197139] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.197343] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.197438] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.197687] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.197788] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.197850] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.197996] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.198088] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.198171] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7ac51ce-a3d8-4ba8-9613-e65b6f4735db is going to be created. [ 1417.259315] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.259548] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.259548] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.259745] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.259916] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.269599] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7ac51ce-a3d8-4ba8-9613-e65b6f4735db in Status: IN_PROGRESS for 2s [ 1417.614977] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1417.614977] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1419.283413] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7ac51ce-a3d8-4ba8-9613-e65b6f4735db in Status: SUCCESS [ 1419.283413] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7ac51ce-a3d8-4ba8-9613-e65b6f4735db" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1422.615728] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1422.616140] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1427.616975] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1427.617449] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1432.618106] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1432.618555] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1437.619269] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1437.619641] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1442.620817] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1442.621330] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1447.622052] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1447.622436] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1452.623459] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1452.623871] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1457.624280] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1457.624657] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1462.625197] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1462.625632] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1467.626389] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1467.626763] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1472.626615] env[65943]: INFO networking_nsxv3.common.synchronization [req-f5a57728-6ffc-4b30-a78f-8d643e83e395 req-4790262d-5756-409c-afd7-94676f0ffcb2 tempest-AttachVolumeNegativeTest-962354070 tempest-AttachVolumeNegativeTest-962354070-project-member] Enqueued Resource ID: e7ac51ce-a3d8-4ba8-9613-e65b6f4735db with Priority: HIGHEST for action security_group_members [ 1472.626877] env[65943]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7ac51ce-a3d8-4ba8-9613-e65b6f4735db with Priority: HIGHEST for action security_group_members [ 1472.626950] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7ac51ce-a3d8-4ba8-9613-e65b6f4735db taken with stack trace [, , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1472.627087] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7ac51ce-a3d8-4ba8-9613-e65b6f4735db" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1472.627156] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7ac51ce-a3d8-4ba8-9613-e65b6f4735db" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1472.627378] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7ac51ce-a3d8-4ba8-9613-e65b6f4735db" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1472.627536] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1472.627634] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1472.627692] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1472.627846] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1472.627932] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1472.628041] env[65943]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7ac51ce-a3d8-4ba8-9613-e65b6f4735db',) {} {{(pid=65943) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1473.130710] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.130946] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.130946] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.131176] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.131294] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.131508] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.131612] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.131677] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.131836] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.131918] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.132015] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7ac51ce-a3d8-4ba8-9613-e65b6f4735db is going to be updated. [ 1473.171849] env[65943]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65943) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.172096] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.172096] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.172274] env[65943]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.172455] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.180987] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7ac51ce-a3d8-4ba8-9613-e65b6f4735db in Status: IN_PROGRESS for 2s [ 1475.192474] env[65943]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7ac51ce-a3d8-4ba8-9613-e65b6f4735db in Status: SUCCESS [ 1475.192849] env[65943]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7ac51ce-a3d8-4ba8-9613-e65b6f4735db deletion is rescheduled due to dependency. [ 1475.192849] env[65943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7ac51ce-a3d8-4ba8-9613-e65b6f4735db" {{(pid=65943) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1477.627845] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1477.628256] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1482.629173] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1482.629558] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1487.629958] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1487.630364] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1492.388503] env[65943]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1492.388913] env[65943]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1de82d17-e919-45c8-94aa-9f15714a52bf None None] NSXv3 Agent Agent loop - iteration:4 started [ 1492.631403] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1492.631634] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1497.632987] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1497.632987] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1502.634164] env[65943]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1502.634618] env[65943]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0